Tensor network states and algorithms in the presence of a global SU(2) symmetry 
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The benefits of exploiting tlie presence of symmetries in tensor network algoritiims iiave been 
extensively demonstrated in the context of matrix product states (MPSs) . These include the ability 
to select a specific symmetry sector (e.g. with a given particle number or spin) , to ensure the exact 
preservation of total charge, and to significantly reduce computational costs. Compared to the case 
of a generic tensor network, the practical implementation of symmetries in the MPS is simplified 
by the fact that tensors only have three indices (they are trivalent, just as the Clebsch-Gordan 
coefficients of the symmetry group) and are organized as a one-dimensional array of tensors, without 
closed loops. Instead, a more complex tensor network, one where tensors have a larger number of 
indices and/or a more elaborate network structure, requires a more general treatment. In two recent 
papers, namely (i) [Phys. Rev. A 82, 050301 (2010)] and {ii) [Phys. Rev. B 83, 115125 (2011)], we 
described how to incorporate a global internal symmetry into a generic tensor network algorithm 
based on decomposing and manipulating tensors that are invariant under the symmetry. In (i) we 
considered a generic symmetry group Q that is compact, completely reducible and multiplicity free, 
acting as a global internal symmetry. Then in (ii) we described the implementation of Abelian group 
symmetries in much more detail, considering a U(l) symmetry {e.g., conservation of global particle 
number) as a concrete example. In this paper we describe the implementation of non- Abelian group 
symmetries in great detail. For concreteness we consider an SU(2) symmetry {e.g., conservation of 
global quantum spin). Our formalism can be readily extended to more exotic symmetries associated 
with conservation of total fermionic or anyonic charge. As a practical demonstration, we describe 
the SU(2)-invariant version of the multi-scale entanglement renormalization ansatz and apply it to 
study the low energy spectrum of a quantum spin chain with a global SU(2) symmetry. 

PACS numbers: 03.67.-a, 03.65. Ud, 03.67.Hk 



I. INTRODUCTION 

In recent years, tensor network statesi"— have become 
an important tool to study quantum many-body systems 
on a lattice. On the theoretical side, they offer a natural 
framework to investigate and classify the possible phases 
of quantum matter—^—. On the numerical side, they are 
the basis of novel computational approaches capable of 
addressing non-perturbatively a large range of interacting 
systems, including two-dimensional systems of frustrated 
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and of interacting fermionsi^ — 



spms 

Tensor network states for one dimensional systems 
include the matrix product state-"* (MPS), which is 
the basis of the density matrix renormalization group^ 
(DMRG) algorithm for computing ground states and 
the time-evolving block-decimationi^ (TEBD) algorithm 
for simulating time evolution; the tree tensor network^S 
(TTN); and the multi-scale entanglement renormaliza- 
tion ansatz'^"''^^ (MERA) for critical systems. In two (and 
more) spatial dimensions, one can still use a MFS^S"— or 
TTNf2£d2. although these tensor networks can only rep- 
resent small systems since they do not offer an efhcient, 
scalable description. In contrast, a projected entangled 
pair staters (PEPS), which is a higher dimensional gener- 
alization of MPS, as well as higher dimensional versions 
of the MERAf^ offer a scalable description in two and 
larger dimensions. Presently, the main limitation of ten- 



sor network methods comes from the fact that simulation 
costs increase rapidly with the amount of entanglement 
in the system, which introduces a bias towards weakly 
entangled phases. In addition, in dimensions larger than 
one, both PEPS and MERA can only efficiently represent 
ground states that obey a boundary law for entanglement 
entropy ) ^'^1^* although the recently proposed branching 
MERA overcomes this limitation?2^i?^ 

In this paper we are concerned with incorporating 
symmetries into tensor networks. The presence of sym- 
metries can be a powerful advantage in numerical ap- 
proaches. A many-body Hamiltonian H may be invari- 
ant under certain transformations, which form a group of 
symmetrieSf21 The symmetry group divides the Hilbert 
space of the theory into symmetry sectors labeled by 
quantum numbers or conserved charges. By targeting 
a specific symmetry sector during a calculation, compu- 
tational costs can often be significantly reduced while 
explicitly preserving the symmetry. Here we will be con- 
cerned with global internal symmetries of lattice mod- 
els, where internal means that the symmetry acts on the 
Hilbert space of each site of the lattice, whereas global 
means that the symmetry acts identically on all sites. 

In this paper we address, in a pedagogical way, the 
implementation of (global internal) non- Abelian symme- 
tries in tensor network algorithms. For concreteness we 
consider the context of SU(2) symmetry which corre- 
sponds, for instance, to spin isotropy. Following Ref. [t^ 
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FIG. 1; (Color online) Computational gain obtained by ex- 
ploiting the symmetry in an MPS algorithm. Computation 
time (in seconds) for one iteration of the "infinite Time Evolv- 
ing Block Decimation""^ (TEBD) algorithm, as a function of 
the MPS bond dimension x is shown. Here x is a refine- 
ment parameter, a larger x leads to a better accuracy of the 
method. For sufficiently large x, exploiting symmetry leads to 
reductions in computation time. The horizontal line on this 
graph shows that this reduction in computation time equates 
to the ability to evaluate MPSs with a higher bond dimension 
X- For the same cost per iteration incurred when optimizing 
a regular MPS in MATLAB with bond dimension x = 220, 
one may choose instead to optimize a U(l)-symmetric MPS 
with X = 380 or an SU(2)-symmetric MPS with x = 1300. 



we consider tensors that are invariant under the sym- 
metry and describe how an SU(2)-invariant tensor com- 
pactly decomposes into a degeneracy part, which con- 
tains all degrees of freedom not determined by symmetry, 
and a structural part that corresponds to intertwiners or 
generalized Clebsch-Gordan coefficients) of SU(2). [In 
contrast to the Abelian case, which we addressed in de- 
tail in Ref. [t^ here the Clebsch-Gordan coefficients of 
the group are non-trivial.] Consequently, a tensor net- 
work made of SU(2)-invariant tensors decomposes as a 
linear superposition of spin networks^^ which, here, en- 
code the constraints imposed by the symmetry on the 
tensor network. We describe how this decomposition of 
an SU(2)-invariant tensor network can be maintained and 
exploited for computational gain in a tensor network al- 
gorithm. As a practical demonstration we describe the 
SU(2)-invariant version of the MERA and apply it to 
study the low energy spectrum of a quantum spin chain 
with spin isotropy. 

Our approach to incorporate the symmetry into ten- 
sor network algorithms takes into account only the to- 
tal spin i while the Clebsch-Gordan coefficients and the 
quantum number m, corresponding to the spin projection 
along the z-axis, appear only to develop the formalism 
and facilitate discussion. Instead, the only data required 



from the symmetry group are the (i) list of irreps of the 
group, (ii) the fusion rules, that is, the decomposition of 
the tensor product of two irreps into the direct sum of 
irreps, (iii) the recoupling coefficients (or 6j-symbols) of 
the group that relate the different ways of fusing three ir- 
reps, and (iv) the swap coefficients, Eq. (|B49p . On the one 
hand, working only with this data allows for a manifestly 
SU(2)-invariant treatment of tensors. On the other, it 
leads to reduction in computational costs in symmetric 
tensor network algorithms, since the Clebsch-Gordan co- 
efficients are eliminated from the description of SU(2)- 
invariant tensor networks. 

Moreover, by not emphasizing the internal degrees of 
freedom m of the symmetry group our formalism can be 
readily generalized (see Sec. |V]) to include more exotic 
symmetry constraints associated, for instance, with the 
deformed group SU{2)k that appears in the context of 
conservation of total anyonic charge in lattice models of 
anyons (in case of SU{2)k there is no internal irrep space 
corresponding to the label m and therefore no Clebsch- 
Gordan coefficients). Our formalism may be generalized 
to this case by replacing the data (i)-(iv) for SU(2) by 
that for SU{2)k. In fact, the present work corresponds 
to the special case A; — > oo and as such also serves to 
illustrate the basic ingredients that are required for the 
implementation of anyonic constraints albeit in the more 
familiar context of SU(2) symmetry and spin systems. 



A. Related work 

The implementation of symmetries is well understood 
in the context of the MPS. Both space (e.g. translation 
invariance) and global internal symmetries (Abelian and 
non- Abelian) have been thoroughly incorporated into al- 
gorithms based on an MPS, namely in DMRCS-W and 
TEBDj^iii^"— where it has been exploited to obtain com- 
putational gains. Figure [1] is demonstrative of the colos- 
sal computational gain that has been obtained by ex- 
ploiting the symmetry in the context of the MPS. Figure 
1181 shows an analogous comparison in the context of the 
MERA. 

The use of symmetric tensors in more complex ten- 
sor networks has also been discussed in Refs. [Sisi In 
particular, Ref. has shown that under convenient con- 
ditions (injectivity) , a PEPS that represents a symmetric 
state can be represented with symmetric tensors, gener- 
alizing similar results for MPS obtained in Ref. [1^. We 
notice that these studies are not concerned with how to 
computationally protect or exploit the symmetry, which 
is the focus of the present paper. 

The implementation of non-Abelian symmetries in 
generic tensor network algorithms was recently addressed 
in Ref. HH, based again on the use of symmetric tensors i21 
A remarkable aspect of Ref. [8l| is that it deals with 
non-Abelian groups with multiplicity)^^ such as SU(3) 
(also see Sec. |V]). However, we note that in Ref. |8l|, 
the Clebsch-Gordan coefficients that appear in the de- 
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plementations. App. |^ reviews the tensor network for- 
malism and the diagrammatic representation of tensors. 
It also describes a set V of primitive operations for ma- 
nipulating tensor networks, namely, the reversal, per- 
mutation, fusion and splitting of the indices of a ten- 
sor and matrix operations, namely, matrix multiplication 
and matrix factorization. App. [B]reviews the relevant re- 
sults from the representation theory of SU(2). In App. [C] 
we describe our implementation of the set V of primitive 
tensor networks manipulations based on decomposing in- 
dividual SU(2) invariant tensors as a tree. 



FIG. 2: (Color online) The schematic organization of the pa- 
per. 



composition of invariant tensors explicitly participate 
in the contraction of tensors. This is in contrast with 
our approach where Clebsch-Gordan are not used (only 
6j-symbols are required), which leads to computational 
gains. In addition, in smte of claiming to address generic 
tensor networks, Ref. [Sllonly demonstrates the approach 
in the context of an MPS, for which there is already 
extensive literature. In contrast, here we will describe 
and address the practical computational issues that arise 
in using non-Abelian symmetries in complex tensor net- 
works. 

The implementation of conservation of total fermionic 
and anyonic charges was described in e.g. Refs. [sqIIgtI 
and Refs. [sl and HI, respectively. 



B. Organization of the paper 

The schematic organization of this paper is shown in 
Fig. [21 It closely follows Ref. 179|, where implementa- 
tion of Abelian symmetries was presented by the au- 
thors. Therefore the differences between the Abelian and 
non-Abelian implementation are highlighted throughout 
the discussion. We note that our specific implementation 
of non-Abelian symmetries in tensor networks, which is 
based on tree decompositions of SU(2)-invariant tensors, 
is presented in App. [C] 

In Sec. In] we characterize SU(2) invariant tensors and 
describe their compact canonical decomposition into de- 
generacy and structural parts. Then in Sec. IIIII we con- 
sider tensor networks made of such tensors. We describe 
how a set V of primitive tensor networks manipulations 
is adapted to the presence of the symmetry. Section ITVl 
contains a practical demonstration of exploiting SU(2) 
symmetry in a tensor network algorithm by presenting 
MERA calculations of the ground state and low en- 
ergy states of the spin- 1/2 anti- ferromagnetic Heisenberg 
chain. Section |V] contains a brief summary of the paper 
and some remarks pertaining to extending the present 
formalism to more general symmetry constraints. 

An important part of the paper is devoted to appen- 
dices, where we present review material and specific im- 



II. SU(2)-INVARIANT TENSORS 

In this section we consider tensors that are invariant 
under the action of SU(2) and explain how such tensors 
decompose into a compact canonical form which exploits 
their symmetry. For a review on the tensor network for- 
malism and its diagrammatic notation, see App. [X] For 
a review on the representation theory of SU(2), see App 

m 



A. Symmetry constraints 

Let T be a rank-A; tensor with components Ti-^i^...i^, 
(see App. 1^ and D denote the directions of its indices 
*2, • ■ ' I Here, D{1) ='in' if index ii is incoming and 
D{1) ='out' if it is outgoing. Each index ii is associated 
with a vector space V(') on which SU(2) acts by means of 
transformations Wr^\ Also consider the action of SU(2) 
on the space 



given by 



where 



if D{1) = 'in' 



(1) 
(2) 




(Wr^''' * denotes the complex conjugate oiWr''^ .) That is, 
Yr*'''' acts differently depending on whether index ii is an 
incoming or outgoing index. 

We say that tensor T is SU(2)-invariant if it is invariant 
under the transformation of Eq.Q. In components, 



T, 



(4) 



for all r G 
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(a) (b) (c) 



(a) 



FIG. 3: (Color online) Constraint fulfilled by (a) an SU(2)- 
invariant vector, (b) an SU(2)-invariant matrix, and (c) a 
rank-3 SU(2)-invariant tensor with two incoming and one out- 
going index. 



Example 1. An SU(2)-invariant vector fulfills 

(^)-' = y. f^r) *a V r e M^ (5) 

— V / a' a 



in accordance with Eq. (jB25| ). see FiglSja). I 

Example 2. An SU(2)-invariant matrix T fulfills 

— V / a' a V / h'h 
a.b 

= E(^rW) T.,(Ty(2)t) (7) 

— \ / a'a \ / bo' 



for all r G , in accordance with Eq. f|B29P , see 
FigMb). I 

Example 3. Tensor T with components Tabc where a 
and h are incoming indices and c is an outgoing index is 
SU(2)-invariant iff 



i=0,t,m) 



0,t) O-m) 



(b) To = Pi 



(c) b G„t. ) ) (d) 



a = O,tJ G=0,rTT,=0) 



FIG. 4: (Color online) (a) Each index i = {j,tj,mj) of an 
SU(2)-invariant tensor that is written in the spin basis de- 
composes into a degeneracy index {j,tj) and a spin index 
{j,mj) in accordance with the decomposition (|B14|) of the 
vector space associated with it. (b) Only j = is relevant for 
an SU(2)-invariant tensor with one index, (c)-(e) For fixed 
value of ja and jt a rank-2 SU(2)-invariant tensor Tab decom- 
poses into a degeneracy tensor Pj^j^ and a structural term 
that depending on the directions of a and 6 is the Identity 
(c), tensor Cj^^^^^^^^^^^oo (d), or tensor CJj!;'^_^,„^ ^^.^^^^ 
(e). 



1. One index 

Consider an SU(2)-invariant tensor T with an index 
a = {j,tj,nij) = (0,io,0) (that is, only irrep j = is 
relevant on the one index). We have [FigHJ^b)] 



(10) 



— \ /a'a V /h'h \ / c' c 

a,o,c 

(*?'). J- <»' 

for all r e M^ see FiglS^c). I 

B. Block structure 

Let us now write tensor T that fulfills Eq.(|4]) in the 
spin basis for each factor space in Eq.(IT]), that is, ii — 
{ji,tj^,mj,),i2 = {j2,tj^,mj^),...,ik = (jfc, t^, , J. 
For fixed value of j's, each index ii decomposes [Fig|4l[a)] 
into a degeneracy index (ji , tj^ ) and a spin index {ji , nij^ ) 
in accordance with the decomposition (|B14[) of the vec- 
tor space V'-'-' associated with it. Tensor T decomposes 
into a degeneracy tensor P that carries all the degeneracy 
indices and a structural tensor (or an intertwiner) that 
carries all the spin indices. In particular, this implies that 
an SU(2)-invariant tensor T has a sparse block structure 
- several of its components are identically zero. Next, we 
describe this block structure for SU(2)-invariant tensors 
with one, two, three and then an arbitrary number of 
indices. 



where (-P)to, shorthand for (rj=o)to.nio=0; encodes the 
non-trivial components of T. 

2. Two indices 

An SU(2)-invariant tensor T with an outgoing index 
= (ja 7 J tj^ ) and an incoming index b = {ji, , ruj^ , tj^ ) 
decomposes as (Schur's lemma) 



{T)ab = (PjaJth^t.Jj^jJn 



(11) 



where (degeneracy) tensors Pjajb with components 
(-^3a3b)tjatj^ carry the two degeneracy indices {ja,tj^) and 
(jb, ijj, see FiglUc). The term Sj^jjrrij^nij^ corresponds 
to the constraints imposed by the symmetry on the ten- 
sor T, namely, only components {T)ab with ja = jb and 
vrij^ — nij^ are non-trivial. 

The constraints, and therefore the decomposition of 
T, depend on the arrangement of arrows on the indices 
(since different arrangement of arrows correspond to a 
different action of the group). When both a and b are 
incoming indices, tensor T decomposes as 



3am ,ji,mj ->-00' 



(12) 



where C-'^'^. _^qq corresponds to the constraint that 

spins ja and jb fuse into a total spin j = 0, Figdjd). That 
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is, components {T)ab are identically zero unless ja = jb 



and rrij^ + nij^ — 0. 



c b (ic,t ) {i;,t ) 0„m ) ) 



Analogously, when a and b are both outgoing indices 
we have [FigHJe)] 



{T)ab i^jajb)tj^tj^ C'oO-i-jamj^ 



(13) 



The decomposition of an SU(2)-invariant tensor T with 
two indices a and b can generally be written as 

{T)ab — i.Pjajb)tj^tj^{Qjajh)mj^mj^i (14) 

which can also be recast in a block-diagonal form, 

3 

= 0(P,.^Q^.), J^j^=jb. (15) 



Example 4- Let us estimate the sparseness of an SU(2)- 
invariant tensor when it is decomposed into degeneracy 
and structural parts. Consider an SU(2)-invariant tensor 
T with two incoming indices each of which is associated 
with the vector space V, 

V = (Bo^Vo)® (Di(8)Vi)©(D2«)V2), 

where the dimensions of the degeneracy spaces DqiIDi 
and D2 are c?o = 1 , di = 3 and d2 — I respectively. Tensor 
T decomposes as 

f EE (Po ® Qo) © (A ® Ql) © (A © 

where Pj is a (degeneracy) matrix that acts on the space 
Dj and Qj is a matrix made of Clebsch-Gordan coeffi- 
cients, {Qj)m,m'- = C'^mj.jm'^oo' ^^at acts On the space 
Vj. The dimension of the vector space V is djAj — 
15. Thus, the total number of complex coefficients con- 
tained in f is If] = 15 X 15 = 225. However, f can be 
stored compactly by only storing the degeneracy tensors 
Pqj Pi and A- The total number of complex coefficients 
to be stored in this case is equal to 

|Po| + |A| + |A|=rfg + d? + rf2-ll- 

That is, by exploiting the symmetry the number of co- 
efficients that need to be stored is about twenty times 
smaller. I 



3. Three indices 

The Wigner-Eckart theorem establishes that an 

SU(2)-invariant tensor T with three indices a — 

{ja,mj^,tj^),b = {jb,mj^,tj^) and c = {jc,mj^,tjj de- 
composes as 





(a) 



(b) 



FIG. 5: (Color online) Examples of the decomposition of 
rank-3 SU(2)-invariant tensors into degeneracy tensors P and 
Clebsch-Gordan tensors. 



where tensors Qj^j^j^ depend on the particular choice 
D of incoming and outgoing indices. The components 
(Q3ajbjc)mj^mj^mj^ are the Clebsch-Gordan coefficients 
given as (e.g. see FiglS]) 



fuse 


if i3 = 


{'in', 'in', 'out'}. 


(17) 


fuse 


if i5 = 


{'in', 'out', 'in'}. 


(18) 


fuse 


if z? = 


{'out', 'in', 'in'}. 


(19) 


split 


if z? = 


{'out', 'in', 'out'}. 


(20) 


split 


if z5 = 


{'out', 'out', 'in'}. 


(21) 


^ split 


if z5 = 


{'in', 'out', 'out'}. 


(22) 



(The remaining two cases D = {'in', 'in', 'in'} and 
D = {'out', 'out', 'out'} correspond to rank-4 intertwin- 
ers associated with fusing ja, jb and jc into a total spin 
j = 0, and are covered in the next subsection.) The 
decomposition Eq. fTB)) can be recast in a "block" form, 



P — Pjajbja ' 

jajbja 

= (^Pjajbjc ® Qjajbjc^ ^ 



(23) 



{T)abc — {Pjajbjc)tjatj.tj^{Qjajbja)mj^7nj 



(16) 



where we use the direct sum symbol ^ to denote that the 
different tensors (or blocks) Tj^j^j^ are supported on or- 
thonormal subspaces of the tensor product of the spaces 
associated with indices a, b and c; the direct sum is over 
all compatible values oi ja,jb and jc- 



4- fc > 3 indices 

A rank-4 SU(2)-invariant tensor T with incoming in- 
dices a = ija,tj^,mjj,b = {jb,tj^,mjj and c = 
{jc,tj^,mjj and outgoing index d = ijd,tja,mj^) can 
be decomposed as 

{T)abcd = iPjllb 1r 7rf ) tjg iib tjg tu ^ 

where Q-'," , . , is the intertwiner (analogous to 

Jajbjcjd ^ ^ 

Ea. (jB72p ) that describes the fusion of ja^jh and jc into a 
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FIG. 6: (Color online) Two different canonical decompositions 
of a rank-4 SU(2)-invariant tensor T into (P, Q) and (P', Q') 
tensors corresponding to two different choices of the fusion 
tree. 



total spin jd by first fusing jc and j'f, into an intermediate 
spin je and then fusing je with ja- 

Alternatively, tensor T can be decomposed as 



3S 



^^jljbjajd )™ia "ib "Ijc ™3d ' 



where Q'j^j^j^j^ (analogous to Eq. (jB74p ) is the inter- 
twiner associated with fusing ja,jb and jc differently. 
That is, first fusing jb and ja into an intermediate spin 
jf and then fusing spin jc with jf. Since Eqs. (|24p and 
(PSj) represent the same tensor T, P and P' are related 
by an F-move [Ea. (IB75|) ]. 




p'jf _ \ ' piej/ p. 

jajbjcjd jajbjajd J 



(26) 



FIG. 7: (Color online) (a) A tensor network made of SU(2)- 
invariant tensors represents an SU(2)-invariant tensor T. This 
is seen by means of two equalities. The first equality is ob- 
tained by inserting resolutions of Identity I = W^rW^r on each 
index connecting two tensors in J\f (the small dark circles 
depict the transformation Wr whereas the small light circles 
depict the adjoint transformation W^)- The second equality 
follows from the fact that each tensor in A/" is SU(2)-invariant. 
(b) For fixed values of j's on all indices, the tensor network 
A/" decomposes into a tensor network made degeneracy tensors 
and a spin network. The sum is over all j's, and the corre- 
sponding t's and m's, that are associated with the contracted 
indices. 



For a different choice of incoming and outgoing indices, 
the degeneracy tensors P and P' are related by a dif- 
ferent F-move e.g. Fig|29la). (Analogous to the rank-3 
case, a rank-4 SU(2)-invariant tensor with all incoming 
or all outgoing indices corresponds to rank-5 intertwin- 
ers associated with fusing the four spins into a total spin 
J = 0.) 

More generally, an SU(2)-invariant tensor T with k 
indices ii = (ji, , J, 12 = ij2,tj^,mj^) and ik = 
(jk , ijk J "f^jk ) decomposes as 



y^hh-jk ) 



mj^mj^...mj^ 



(27) 



where C^^X''^^-' 

The intertwiner Q^!^^''^^ ■'^fc-.! can further be decomposed 
into a trivalent tree tensor network made of (7''"'^° and 
(J split tejigors. This decomposition is completely speci- 
fied by its underlying graph, the fusion- splitting tree^, 
that is additionally decorated by labeling its links with 
j's. Here, the fusion-splitting tree consists of fc — 2 ver- 
tices associated with fusions (two incoming arrows and 



is a rank-fc intertwiners of SU(2). 



one outgoing arrow) and/or splittings (one incoming ar- 
row and two outgoing arrows), fc — 3 internal edges that 
interconnect the vertices and k open edges. The internal 
edges are labeled by {jenje^i ■ ■ ■ ^jek-'A while the open 
edges are labeled by {ji, j2, ■ • ■ , jfe}- 

We refer to the decomposition (P, Q) as the canon- 
ical decomposition or the canonical form of tensor T. 
The canonical form is the most compact description of 
an SU(2)-invariant tensor T in that T can be stored in 
memory by only storing the degeneracy tensors P and 
the underlying fusion-splitting tree. A different choice 
of the tree will produce different sets of tensors P' and 
Q', related to P and Q by F-moves (and also possibly 
Inswap coefficients in case the underlying fusion-splitting 
tree has crossings). We also refer the reader to App. C 
where we describe tree decompositions, a canonical form 
of SU(2)-invariant tensors that is based on splitting trees, 
that is, trees made of only splitting vertices. 



III. SU(2)-INVARIANT TENSOR NETWORKS 

In this section we describe how to incorporate SU(2) 
symmetry into tensor networks. We refer to App. \K\ for 
a review on the tensor network formalism. 

In particular, in App. I A 71 we review how a tensor net- 
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work M can be interpreted as a collection of linear maps 
composed into a single linear map T of which A/" is a 
tensor network decomposition. By introducing a spin 
operator on the vector space associated to each line of 
Af, we can define a unitary representation of SU(2) on 
each index of each tensor in Af. Then we say that Af is 
an SU(2)-invariant tensor network if all its tensors are 
SU(2)-invariant. Notice that, by construction, if Af is an 
SU(2)-invariant tensor network, then the resulting lin- 
ear map T is also SU(2)-invariant. This is illustrated in 
FiglZta). 

Linear superposition of spin networks. We can now in- 
vestigate how the tensor network decomposes if we write 
each of its tensors T in the (P, Q) form. For any fixed 
value of the j's on all the indices, the whole tensor net- 
work factorizes into two terms, as illustrated in FigjTl^b). 
The first one is a tensor network of degeneracy tensors. 
The second one is a directed graph with edges labeled 
by spins j and vertices labeled by intertwining operators 
of SU(2) i.e. the Q tensors. This is nothing other than 
a spin network. Accordingly, an SU(2)-invariant tensor 
network for the j^*) G of a lattice C oi L sites can 
be regarded as a linear superposition of spin networks 
with L open edges. The number of spin networks in the 
linear superposition grows exponentially with the size of 
the tensor network. The expansion coefficients are given 
by the degeneracy tensors. 



Operation 


Degeneracy tensors 


Intertwiners 


Definition 


Reversal 


regular e.g. Eq.dAlll 




Eqs.(1B79|I-(|B80() 
Figl2Hi:c)-(e) 


Swap 


regular e.g. Eq.(|A2[l 


swap 


Eqs.(1B49|I-P50|) 


Fusion 






Eqs.(1B42|I.(1B59|I 
Figsl26l27l 


Splitting- 


split 


^ split 


Eqs.(|B45|I.(|B61|I 
Fie:sl26l27l 



TABLE I: Transformations tliat play an instrumental role in 
the reversal, swap and reshape (fusion and splitting) of in- 
dices of SU(2)-invariant tensors when working in the canoni- 
cal form. These manipulations are addressed separately and 
differently for the degeneracy tensors and for the structural 
tensors (intertwiners) . 



in App. lA 5[ namely, reversal, permutation and reshap- 
ing indices, matrix multiplication and factorizations, can 
be addressed separately for the degeneracy term and the 
spin network term, see Table L 

App. [C] describes our implementation of the primitive 
tensor network manipulations based on tree decomposi- 
tions of SU(2)-invariant tensors. 



Reversal of indices 



A. Tensor network states and algorithms with 
SU(2) symmetry 

As reviewed in App. lA 6[ a tensor network Af can be 
used to describe certain pure states G V®-'" of a lattice 
C. If A/" is an SU(2)-invariant tensor network then it will 
describe a pure state l^*) that has a well-defined total 
spin i = 0. That is, an SU(2)-invariant pure state fulfills 

Ja\^)=0, a^x,y,z. 

In this way we can obtain a more refined version of pop- 
ular tensor network states such as MPS, TTN, MERA, 
PEPS, etc. As a variational Ansatz, an SU(2)-invariant 
tensor network state is more constrained (by the appear- 
ance of spin networks in its canonical decomposition) 
than a regular tensor network state, and consequently 
it can represent fewer states \^) G V®^. However, it 
also depends on fewer parameters (those encoded in the 
degeneracy tensors). This implies a more economical de- 
scription, as well as the possibility of reducing computa- 
tional costs during its manipulation. 

In the rest of the section we explain how to reduce 
computational costs by exploiting the symmetry. This 
is based on storing and manipulating SU(2)-invariant 
tensors expressed in the canonical form of Ea. (l?fl) and 
the consequent decomposition of the tensor network as 
a linear superposition of spin networks. By decompos- 
ing the tensor network in this way, the primitive tensor 
network manipulations belonging to the set V reviewed 



Unlike regular tensors, bending indices of an SU(2)- 
invariant tensor T produces a different SU(2)-invariant 
tensor. Moreover, the resulting tensor is generally dif- 
ferent when bending an index from the left than when 
bending it from the right. That is, the "parity" of the 
bend has to be taken into account. For example, con- 
sider an SU(2)-invariant tensor T with outgoing indices 

= (ja I ija 1 ''TT'ja ) b = (jb , tj^ , mj^ ) and incoming in- 
dex c = {jc,tj^,mj^) and components [Eqs. ((T6|) . (|2II) ]. 

and let T' denote the SU(2)-invariant tensor that is ob- 
tained from T by bending the outgoing index a from the 
left. In the canonical form tensor T' has components 
T' 

abc 

^{Pl . . C>!1 . ^. (29) 

where 

P4 . . = , A- . (30) 

JaJbJc ^3a3a3b Jajbja \ J 

Here a = {j ai'^ja^^ja) — Uaitja^ ^''^ja) denotes the in- 
dex obtained by bending a and the factor Mj3ci6 
fined according to Ea. (IB79|) . The derivation of Eg. ((30)) 
is shown in FigEl^a). Note that the components of de- 
generacy tensor Pj^j^j^ remain unchanged when bending 
its index {ja , tj^ ) (recall that the degeneracy tensors are 
not constrained by the symmetry). On the other hand. 




Ja 



Jc 



1 Jb 



^ iaJcJb 





Ja Jb 



P' ja jb 



The 



FIG. 8: (Color online) [Contrast with FialWa)] (a) 
leftward bending of an outgoing index a — ija,tj^,mj^) 
of an SU(2)-invariant tensor T given in the canonical form 
(P, (7=?'") to obtain another SU(2)-invariant tensor T' , shown 
in two steps. The first step shows that for fixed values of 
ja , jb and jc , the degeneracy index {ja , tj^ ) and the spin index 
{ja,mj^) can be bent separately. Degeneracy tensor PjaibOc 
remains unchanged (like a regular tensor) by bending its in- 
dex (ja,tj^). In contrast, bending the index {jajTrij^) cor- 
responds to "multiplying" the structural tensor (7=p''' with 
the cup f^j"'' such that (ja,?Tija) is contracted. This mul- 
tiplication corresponds to applying the F-move of Fie: l29f c'). 
The second step corresponds to multiplying the resulting fac- 
tor into the degeneracy tensors P to obtain T' in the 

canonical form (P', C^"'"), F,q.^. (b) Tensor f is recovered 
from T' by bending a downward using the cap transformation 
fJJJ^^ as shown and restoring the canonical form by applying 
the inverse F-move [Fig[29l;d)], leading to Eq.((3T|). 



bending of the spin index (ja, mja) is subject to the sym- 
metry constraint that ja and ja must fuse to a total spin 
j = 0. This corresponds to multiplying the structural 
tensor C^"' with the cup ^j"^, as shown in the figure. 

The SU(2)-invariant tensor T may be recovered from 
T' by bending down index a from the left. This is 
achieved by multiplying the structural tensor with the 



cap ri as shown in FiglSJb). We have 



JaJbJc 



cap A/ 
^JaJc jb jjbjc' 



(31) 



where the factor fJ-jl^j^j^^ is defined according to Eq. (|B80p . 

Next, bending the same index a of the SU(2)-invariant 
tensor T from the right may result in a different SU(2)- 
invariant tensor T" . In the canonical form, the SU(2)- 
invariant tensors T' and T" are related as (see Figl^c)) 



pi . 

>0 'Ja3b3a 



(32) 





nswap 




(j„t_) G,,m ) 0.,m) (j,,t ) (i„tj ) 



FIG. 9; (Color onhne) [Contrast with Fia\2Wh)] Swap- 
ping indices a — {ja,tj^,mj^) and b — {jb,tj^,mj^) of an 
SU(2)-invariant tensor T that is given in the canonical form 
(P, (7=p''') to obtain another SU(2)-invariant tensor T', shown 
in two steps. The first step shows that for fixed values oi ja,jb 
and jc the corresponding indices of the degeneracy tensor and 
the structural tensor can be swapped separately. Swapping 
indices {ja,tj^) and {jb,tjb) of degeneracy tensor Pj^^jbib 
achieved by swapping the labels ja and jb and also the in- 
dices tj^ and tjf^. The analogous swap of the indices (ja, mj^) 
and {jb,rnjb) of the structural tensor is straightforward and 
can be performed algebraically [Ea. (|B49|) ] - the resulting ten- 
sor is simply proportional to another Clebsch-Gordan tensor 
CTm ^,.m i m- timcs the factor P™!^, ■ The second 
step corresponds to multiplying the factor Rj^'^l^j^ into the 
degeneracy tensors Pjajbia to obtain T' in the canonical form, 



from the left Eg. ([50)1 is generalized to 



3l---3r 



P 



■■■J = fc-3 
■3r ■ ■ -jk 



(33) 



where jr , je^ and j label three edges that meet at a vertex 
in the underlying fusion-splitting tree. Depending on the 
specific choice of the tree, here j may label either an open 
or an internal edge. Equation pip can be generalized in 
a similar way for the downward bending of an index of a 
rank-fc SU(2)-invariant tensor. 



C. Permutation of indices 

Next consider permuting indices of an SU(2)-invariant 
tensor that is given in the canonical form. As reviewed 
in App IA 2[ an arbitrary permutation of indices of a ten- 
sor can be decomposed into a sequence of reversals and 
pairwise swaps. Here we explain how to swap two adja- 
cent indices, both 'in' or both 'out', of an SU(2)-invariant 
tensor given in the canonical form. For example, tensor 
T" of Ea. (IA2l) obtained by swapping indices a and b of 
an SU(2)-invariant tensor T [Eg. (1^51) ] has components 



T' = ( P' \ C""^ 

^hac y 3b3a3cl^jb^io.t3<: 3c 



plit 

3cmj^^jbmj^,ja 



(34) 



where 



Notice that in case ja E {0, 1,2,.. .} the factor Rj"^j 

is equal to one and the leftward or rightward bending of 
a results in the same final tensor, T" = T'. 

More generally, consider bending an outgoing index 



„) of a rank-fc SU(2)-invariant tensor 



given in the canonical form of Eq. (j27p . When bending 



(PL 



2 ^^Jb ^3. 



TJ swap 
^ja,jb' 



jc (^3^31, 



(35) 



as explained by FiglHl 

More generally, consider the swap of indices v — 
{jr,t-j,^,mj^) and v+i = {jr+i,tj^^^,mj^^^J of a rank-fc 
SU(2)-invariant tensor. Let us work in a canonical form 
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(a) 



f'r 




(b) c b 



FIG. 11: (Color online) When reshaping incoming indices 
transformations T'"°° and T°''''* reverse roles, (a) Fusion of 
incoming indices is by means of transformation T (b) 
Splitting of an incoming index is by means of transformation 

fuse 



FIG. 10: (Color online) [Contrast with Fia\Md)-(e)] (a) Fu- 
sion, by means of the transformation "f of two indices 
of an SU(2)-invariant tensor T given in the canonical form 
(P, C""'"') to obtain an SU(2)-invariant matrix f'. For fixed 
values of jayjb and jc, the fusion is addressed separately for 
the degeneracy tensors and structural tensors by decomposing 
the transformation T'"^'' into X'""" and C^""" parts. Degener- 
acy indices are fused by multiplying tensors Pj^j^j^ with X 
as shown. For a fixed value of jc tensor Pj^j^ {jd ~ jc) is the 
sum of all reshaped degeneracy tensors Pjaibia with compati- 
ble labels ja , jb and jc ■ The fusion of the spin indices is trivial 
since the structural tensor cancels out with the applied (7 
[FigHHc)], leading to Eq.(|38j. (b) Tensor f is recovered by 
analogously splitting back the index {jd,tja) of T' using the 
transformation T"''"* which decomposes into and C"^"' 

parts. 



in which the two indices ir 
ate index ip. = {je.,ti. 



and ir+i fuse to an intermedi- 
) in the underlying fusion- 



splitting tree. 

as 

jl---jr+ljr 



Then Eg. ([55]) can be readily generalized 



■jk 



O swap 



(36) 



Notice that the canonical form of an SU(2)-invariant 
tensor facilitates a computational speedup for permuta- 
tion of indices since computational cost is incurred only 
by the permutation of indices of the degeneracy tensors. 
Figure [TH illustrates the computational speedup corre- 
sponding to a permutation of indices performed using 
our reference implementation in MATLAB. 



D. Reshape of indices 



where (see Fig[TOja)) 



(PL 



= E 



(38) 

(The sum is over all ja and jb that are compatible with jc-) 

The original tensor T may be recovered from T' by splitting 
index d back into indices a and b. This is achieved by using 
the inverse transformation "f =p''' [Ea. (IB60ll ]. In the canonical 
form we have (see FigfToFbD. 



{PjajbJ<:)t 



3d 



y split 



(39) 

More generally, consider reshaping indices of a rank-fc 
SU(2)-invariant tensor, for instance, by fusing two outgoing 



indices 



and 



if 



Let us once again work in a canonical form in which the 
adjacent indices ir and ir+i fuse to an intermediate index 
ic, = {jcs , tjcs I "^Jes ) underlying fusion-splitting tree. 

In such a canonical form Ea. (|38p generalizes to 



ji-tj. 



(40) 

where the sum is over the two degeneracy indices (jV , tj^ ) and 
(jV+i, ) that are fused. 

Finally, when fusing and splitting incoming indices, the 
transformations T'"°° and X"^'" reverse roles, as illustrated 
in Fig. [Til 

Notice in Ea. (|40p that reshape of indices in the canonical 
form corresponds to rearranging components of the degener- 
acy tensors and then taking a linear combination of them. 
This requires more work, and can therefore incur additional 
computational cost, than reshaping indices of regular ten- 
sors which is a simple rearrangement of the tensor compo- 
nents. For instance, Fig |12l shows that fusing indices of SU(2)- 
invariant tensors can be more expensive than fusing indices 
of regular tensors. 



Two adjacent outgoing indices of an SU(2)-invariant ten- 
sor that is given in the canonical form can be fused together 
by using the transformation T'""" [Ea. (|B55|l ]. For example, 
tensor T' of Eq. (|A3|l obtained by fusing indices a and b of the 
SU(2)-invariant tensor T [Eq. (|28|) ] has components 

T'dc = {PL3a)tj^tjJjajJmj^mj^, (37) 



E. Multiplication of two SU(2)-invariant matrices 

Let M and iV be two SU(2)-invariant matrices given in the 
canonical form 

A^ = 0(Af,®/2,+i), iV = 0(iV,®/2,+i). (41) 
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FIG. 12: (Color online) Computation times (in seconds) re- 
quired to permute indices of a rank-four tensor T as a func- 
tion of the size of the indices. All four indices of T have the 
same size 9d, and therefore the tensor contains IT] = 9*d'' 
coefficients. The figures compare the time required to per- 
form these operations using a regular tensor and an SU(2)- 
invariant tensor, where in the second case each index contains 
three different values of spin j — 0, 1,2, each with degener- 
acy d, and the canonical form of Ea. (|24p is used. The upper 
figure shows the time required to permute two indices: For 
large d exploiting the symmetry of an SU(2)-invariant tensor 
by using the canonical form results in shorter computation 
times. The lower figure shows the time required to fuse two 
adjacent indices. In this case maintaining the canonical form 
requires more computation time. Notice that in both fig- 
ures the asymptotic cost scales as 0(d*), or the size of T, 
since this is the number of coefficients which need to be rear- 
ranged. We note that the fixed-cost overheads associated with 
symmetric manipulations could potentially vary substantially 
with choice of programming language, compiler, and machine 
architecture. The results given here show the performance of 
our MATLAB implementation of SU(2) symmetry. 

Then the SU(2)-invariant matrix T = MN obtained by mul- 
tiplying together matrices M and has the canonical form 

T = ©m®/2,+i), (42) 

j 

where Tj is obtained by multiplying matrices Adj and Nj, 

f,^M,Nj. (43) 

Clearly, computational gain is obtained as a result of perform- 
ing the multiplication T — RS block-wise. This is illustrated 



FIG. 13: (Color online) Computation times (in seconds) re- 
quired to multiply two matrices (upper panel) and to perform 
a singular value decomposition (lower panel) as a function of 
the size of the indices. Matrices of size 9d x 9d are considered. 
The figures compare the time required to perform these op- 
erations using regular matrices and SU(2)-invariant matrices, 
where for the SU(2) matrices each index contains three differ- 
ent values of the spin j = 0, 1, 2, each with degeneracy d, and 
the canonical form of Eg. dlip is used. That is, each matrix de- 
composes into three blocks of size dxd. For large d exploiting 
the block diagonal form of SU(2)-invariant matrices results in 
shorter computation time for both multiplication and singu- 
lar value decomposition. The asymptotic cost scales with d as 
O(d^) while the size of the matrices grows as 0(d^).(For ma- 
trix multiplication a tighter bound of 0(d^'^) for the scaling of 
computational time with d is seen in this example.) We note 
that the fixed-cost overheads associated with symmetric ma- 
nipulations could potentially vary substantially with choice of 
programming language, compiler, and machine architecture. 
The results given here show the performance of our MATLAB 
implementation of SU(2) symmetry. 



by the following example. 

Example 5. Consider vector space V that decomposes as 
V = djVj where j assumes values 1, • • • ,q and let dj = d,\/j. 
The dimension of the space V is 

dim(V) = Aj = dq{q + 2). 

j=i 

An SU(2)-invariant matrix T : V — >■ V decomposes into q 
blocks Tj where each block has size dxd. Therefore, the 
SU(2)-invariant matrix T contains d'^q coefficients. For com- 
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parison, a regular matrix of the same size contains d'^q'^{q+2)'^ 
coefficients, a number greater by a factor of 0{q^). Let us now 
consider multiplying two such matrices. We use an algorithm 
that requires 0(/^) computational time to multiply two ma- 
trices of size I X I. The cost of performing q multiplications of 
dx d blocks in Ea. (|43|) scales as 0{d^q). In contrast, the cost 
of multiplying two regular matrices of the same size scales as 
0{d'^(f'{q + 2)^), requiring 0{q^) times more computational 
time. Figure [T^ shows a comparison of the computation times 
when multiplying two matrices for both SU(2)-invariant and 
regular matrices. I 



F. Factorization of an SU(2)-invariant matrix 

The factorization of an SU(2)-invariant matrix T can also 
benefit from the block-diagonal structure. Consider, for in- 
stance, the singular value decomposition (SVD), T = tJSV, 
where [/ and V axe unitary matrices and S is a diagonal ma- 
trix with non-negative components. If T has the canonical 
form 

T = 0m®/2,+i), (44) 
j 

we can obtain the SU(2)-invariant matrices 

f/ = 0(C/,®/2, + l), 

3 

S = 0(S,®/2, + l), 

3 

l/ = 0(V-®l2, + l), 

i 

by performing SVD of each degeneracy matrix Tj indepen- 
dently, 

f, = UjS.Vj. (45) 

A different factorization of T, such as spectral decomposition 
or polar decomposition, can be obtained by the analogous 
factorization of the blocks Tj . The computational savings are 
analogous to those described in Example 5 for the multiplica- 
tion of matrices. Figure [13] shows a comparison of computa- 
tion times required to perform a singular value decomposition 
on SU(2)-invariant and regular matrices using MATLAB. 



tree. Computationally, this implies a reduction both in mem- 
ory cost, since the Clebsch-Gordan coefficients are not re- 
quired to be stored in memory (instead we only store the F 
and i?=™°^p coefficients), and in computational times since the 
Clebsch-Gordan coefficients are not required to be manipu- 
lated explicitly. 

We have also seen that maintaining the canonical form dur- 
ing tensor manipulations adds some computational overhead 
when reversing or reshaping (fusing or splitting) indices but 
reduces computation time when permuting indices (for suf- 
ficiently large tensors) and when multiplying or factorizing 
matrices (for sufficiently large matrix sizes). The cost of re- 
versing, reshaping and permuting indices is proportional to 
the size |T| of the tensors, whereas the cost of multiplying and 
factorizing matrices is a larger power of the matrix size, for 
example, ifl^^^ The use of the canonical form when manip- 
ulating large tensors therefore frequently results in an overall 
reduction in computation time, making it a very attractive 
option in the context of tensor network algorithms. This is 
exemplified in the next section, where we apply the MERA 
to study the ground state of a quantum spin chain which has 
an SU(2) symmetry. 

On the other hand, however, the cost of maintaining the in- 
variant tensors in the canonical form becomes more relevant 
when dealing with smaller tensors. In the next section we 
will also see that in some situations, this additional cost may 
significantly reduce, or even offset, the benefits of using the 
canonical form. In this event, and in the specific context of 
algorithms where the same tensor manipulations are iterated 
many times, it is possible to significantly decrease the addi- 
tional cost by precomputing the parts of the tensor manip- 
ulations that are repeated on each iteration (see App. [CT)) . 
The performance of precomputing is illustrated in the next 
section. 



IV. TENSOR NETWORK ALGORITHMS WITH 
SU(2) SYMMETRY: A PRACTICAL EXAMPLE 

In this section we demonstrate the implementation of SU(2) 
symmetry in tensor network algorithms with practical exam- 
ples. We do so in the context of the Multi-scale Entanglement 
Renormalization Ansatz, or MERA, and present numerical re- 
sults from our reference implementation of SU(2) symmetry 
in MATLAB. 



G. Discussion 

In this section we have seen that SU(2)-invariant ten- 
sors can be written in the canonical form of Ea. (|27|) and 
that this canonical form offers a compact description in 
terms of components that are not constrained by the sym- 
metry (degeneracy components). Moreover reversal, permu- 
tation and reshape of indices can be implemented only at 
the level of the degeneracy tensors while the intertwiners, 
which are completely constrained by the symmetry, only con- 
tribute numerical factors in the manipulation. In particu- 
lar, these factors depend only on the j's and not on the m's 
[Eqs. (|33|) . p6| ). (|40|) ]. The canonical decomposition therefore 
allows for a manifestly SU(2)-invariant treatment of tensors 
- that is, an SU(2)-invariant tensor is completely specified 
by the degeneracy tensors and the underlying fusion-splitting 



A. Multi-scale entanglement renormalization 
ansatz 

Figure [Til shows a MERA that represent states |*) G V''^' 
of a lattice C made of L = 18 sites. Recall that the MERA is 
made of layers of isometric tensors, known as disentanglers u 
and isometrics w, that implement a coarse-graining transfor- 
mation. In this particular scheme, isometries map three sites 
into one and the coarse-graining transformation reduces the 
L = 18 sites of C into two sites using two layers of tensors. 
A collection of states on these two sites is then encoded in a 
top tensor t, whose upper index o = 1, 2, ■ • ■ , Xtop is used to 
label Xtop states [^a) £ V'^-*. This particular arrangement of 
tensors corresponds to the 3:1 MERA described in Ref [3^ . 
We will consider a MERA analogous to that of Fig |14l but 
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sites made of two layers of disentanglers u and isometries w 
and a top tensor t. 



with Q layers of disentanglers and isometries, which we will 
use to describe states on a lattice £, made of 2 x 3*^ sites. 

We will use the MERA as a variational ansatz for ground 
states and excited states of quantum spin models described 
by a local Hamiltonian H. In order to find an approximation 
to the ground state of H, we set Xtop = 1 and optimize the 
tensors in the MERA so as to minimize the expectation value 

(^'1^1*) (46) 

where \'^) G V''"' is the pure state represented by the MERA. 
In order to find an approximation to the Xtop > 1 eigenstates 
of H with lowest energies, we optimize the tensors in the 
MERA so as to minimize the expectation value 

Xtop 

=5..'. (47) 

a = l 

The optimization is carried out using the MERA algorithm 
described in Ref. 32, which requires contracting tensor net- 
works (by sequentially multiplying pairs of tensors) and per- 
forming singular value decompositions. 



FIG. 15: (Color online) Error in ground state energy AE (in 
the singlet sector J = 0) as a function of x for the Heisenberg 
model with 2L — 108 spins and periodic boundary conditions. 
The error is calculated with respect to the exact solutions and 
is seen to decay polynomially with x for the particular choice 
of spins listed in Table HH 



Total bond dimension, x 


Spins j 


Degeneracies d 


4 


{0,1} 


{1,1} 


8 


{0,1} 


{2,2} 


17 


{0,1,2} 


{3,3,1} 


21 


{0,1,2} 


{4,4,1} 


30 


{0,1,2} 


{5,5,2} 


39 


{0,1,2} 


{6,6,3} 


43 


{0,1,2} 


{7, 7, 3} 


52 


{0,1,2} 


{8,8,4} 


75 


{0,1,2,3} 


{9,9,5,2} 



TABLE II: Example of spin assignment in an SU(2) MERA 
for the anti-ferromagnetic spin chain with L = 54 sites (or 
108 spins). 



B. MERA with SU(2) symmetry 

An SU(2)-invariant version of the MERA, or SU(2) MERA 
for short, is obtained by simply considering SU(2)-invariant 
versions of all of the isometric tensors, namely the disentan- 
glers u, isometries w, and the top tensor t. This requires 
assigning a spin operator to each index of the MERA. We 
can characterize the spin operator by two vectors, j and d: a 
list of the different values the spin takes and the degeneracy 
associated with each such spin, respectively. For instance, an 
index characterized by j = {0, 1} and d — {2, 1} is associated 
to a vector space V that decomposes as V = doVo © di Vi with 
do = 2 and di — 1. 

Let us explain how a spin operator is assigned to each link 
of the MERA. Each open index of the first layer of disen- 
tanglers corresponds to one site of jC. The spin operator on 
any such index is therefore given by the quantum spin model 
under consideration. For example, a lattice with a spin-i as- 
sociated to each site corresponds to assigning spin-i operators 
[Ea. (|B9|) ] to each of the open indices. 

For the open index of the tensor t at the very top the 
MERA, the assignment of spins will depend on spin sector 
J that one is interested in. For instance, in order to find an 



approximation to the S*** lowest [(2J+ l)-fold degenerate] en- 
ergy level of the quantum spin model within the spin sector 
J, we choose j = { J} and d — {8}. 

For each of the remaining indices of the MERA, the assign- 
ment of the pair {j, d) needs careful consideration and a final 
choice may only be possible after numerically testing several 
options and selecting the one which produces the lowest ex- 
pectation value of the energy. 

For demonstrative purposes, we will use the SU(2) MERA 
as a variational ansatz to obtain the ground state and excited 
states of the spin-i antiferromagnetic quantum Heisenberg 
chain that is given by, 

L 

H = ^/I'^'^+i', (48) 

s = l 

where 

h^.^+i) = 4 + J(=) 4^+1) + , (49) 

Jx, Jy and Jz are the spin-i operators [Eq. (|B9|| ]. The hamil- 
tonian H commutes with the group SU(2) which is readily 
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verified by noticing that 



j(s) f{s + l)n 



0, 



x,y,x. 



(50) 



Each spin-i degree of freedom of the Heisenberg chain is de- 
scribed by a vector space V = Vi that is spanned by two 
orthonormal states [Ea. (|B8|) ]. 



-) and \j 



For computational convenience, we wiU consider a lattice jC 
where each site contains two spins. Therefore each site of 
£ is described by a space V = Vo © Vi , where do = 1 and 
di = 1, also discussed in Example B6. This corresponds to 
the assignment j — {0, 1} and d = {1, 1} at the open legs at 
the bottom of the MERA. Thus, a lattice C made of L sites 
corresponds to a chain of 2L spins. 

Table M lists some of the spin and degeneracy dimensions 
assignment (for the internal links of the MERA) that we have 
used in the numerical computations for L = 54 (or 108 spins). 
For a given value of j and d the corresponding dimension x 
can be obtained as, 



X 



= + 1) X dj 



(51) 



Figure [15] shows the error in the ground state energy of the 
Heisenberg chain as a function of the bond dimension x, for 
the assignments of j and d that are listed in Table [TTl For 
the choice of spin assignments listed in the table the error 
is seen to decay polynomially with x, indicating increasingly 
accurate approximations to the ground state. 




FIG. 16: (Color online) Low energy spectrum of H with 
L — 54 sites (=108 spins). Depicted states have spin J of 
zero (x, blue loops), one (+, red loops), or two (o, green 
loop). The superscript close to the boundary of a loop in- 
dicates that the loop encloses two- fold degenerate states e.g., 
the second, third and fourth spin-1 triplets are twofold degen- 
erate. The inset shows a zoom in of the region enclosed within 
the box. It compares the energies of the two-fold degenerate 
spin-one states within the box with those obtained using the 
regular MERA (black asterix points). Since the symmetry 
is not protected the states obtained with the regular MERA 
corresponding to different mj do not have the same energies. 



C. Advantages of exploiting the symmetry 

We now discuss some of the advantages of using the SU(2) 
MERA. 



1. Selection of spin sector 

An important advantage of the SU(2) MERA is that it 
exactly preserves the SU(2) symmetry. In other words, the 
states resulting from a numerical optimization are exact eigen- 
vectors of the total spin operator 

j2 . _^ In ad- 

dition, the total spin J can be pre-selected at the onset of 
optimization by specifying it in the open index of the top 
tensor t. 

Figure shows the low energy spectrum of the Heisen- 
berg model H for a periodic system of L = 54 sites (or 108 
spins), including the ground state and several excited states 
in the spin sectors J = 0, 1, 2. The states have been organized 
according to spin projection mj. We see that states with dif- 
ferent spin projections mj (for a given J) are obtained to be 
exactly degenerate, as implied by the symmetry. 

Similar computations can be performed with the regular 
MERA. However, the regular MERA cannot guarantee that 
the states obtained in this way are exact eigenvectors of . 
Instead the resulting states are likely to have total spin fluctu- 
ations. This is shown in inset of Fig |16l which corresponds to 
the zoom in of the region in the plot that is enclosed within the 
box. The inset shows (black asterix points) the corresponding 



energies obtained for the enclosed two-fold degenerate J = 1 
states using the regular MERA. We see that the states corre- 
sponding to different values of mj are obtained with different 
energies. 

Also note that by using the SU(2) MERA, the three sectors 
J = 0, 1 and 2 can be addressed with independent computa- 
tions. This implies, for instance, that finding the gap between 
the first singlet (J = 0) and the first J = 2 state, can be ad- 
dressed with two independent computations by respectively 
setting (J = 0,Xtop ~ 1) and (J = 2, Xtop = 1) on the open 
index of the top tensor t. However, in order to capture the 
first J = 2 state using the regular MERA, we would need to 
consider at least Xtop = 20 (at a larger computational cost 
and possibly lower accuracy), since this state has only the 
20"^ lowest energy overall. 



2. Reduction in computational costs 

The use of SU(2)-invariant tensors in the MERA also re- 
sults in a reduction of computational costs. We compared the 
computational costs (memory and CPU) associated with us- 
ing the regular MERA and the SU(2) MERA. We also found 
it instructive to compare the analogous costs associated with 
a MERA that is made of tensors that remain invariant under 
only a subgroup U(l) of the symmetry group. This entails 
introducing the spin projection operators Jz on the links of 
the MERA and imposing the invariance of constituent tensors 
under the action of these operators. For such a U(l) MERA, 
imposing such constraints corresponds to conservation of the 
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FIG. 17: (Color online) Memory cost (in number of compo- 
nents) for storing the MERA as a function of the bond dimen- 
sion X- The horizontal line on this graph shows that this re- 
duction in memory cost equates to the ability to store MERAs 
with a higher bond dimension x'- For the same amount of 
memory required to store a MERA with bond dimension 
X = 15 one may choose instead to store a U(l)-symmetric 
MERA with X = 26 or an SU(2)-symmetric MERA with 
X = 39. 



FIG. 18: (Color online) Computation time (in seconds) for 
one iteration of the MERA energy minimization algorithm as 
a function of the bond dimension x- For sufficiently large x 
exploiting the SU(2) symmetry leads to reductions in compu- 
tation time. The horizontal line on this graph shows that this 
reduction in computation time equates to the ability to eval- 
uate MERAs with a higher bond dimension x^ For the same 
cost per iteration incurred when optimizing a regular MERA 
in MATLAB with bond dimension x = 18 one may choose 
instead to optimize a U(l)-symmetric MERA with x = 26 or 
an SU(2)-symmetric MERA x = 33. 



total spin projection mj, while the total spin may fluctuate. 
(The explicit construction of the U(l) MERA was discussed 
by the authors' in Ref. 1791.) 

Figure [TTl shows a comparison of the total number of com- 
plex coefficients that are required to be stored for L = 54 
sites (corresponding to 108 spins) in the three cases: regular 
MERA, U(l) MERA and the SU(2) MERA. U(l)-invariant 
tensora^S, have a block structure in the eigenbasis of Jz op- 
erators on each index of the tensor, and therefore they incur 
a smaller memory cost in comparison to regular tensors. For 
example, it can be seen that for the same memory required 
to store a regular MERA with x = 15, one can instead con- 
sider storing a U(l) MERA with x ~ 21. On the other hand, 
SU(2)-invariant tensors are substantially more sparse. When 
written in the canonical form, SU(2)-invariant tensors are not 
only block-sparse but each block, in turn, decomposes into a 
degeneracy part and a structural part such that the structural 
part need not be stored in memory. With the same amount 
of memory that is required to store, for example, a x = 15 
regular MERA, one can already store a x = 39 SU(2) MERA. 

In Fig llSI we show an analogous comparison of the compu- 
tational performance in the three cases. We plot the compu- 
tational time required for one iteration of the energy mini- 
mization algorithm of Ref. ^ (during which all tensors in the 
MERA are updated once), as a function of the total bond 
dimension x for the cases of regular MERA, U(l) MERA 
and SU(2) MERA. We see that for sufficiently large X) using 
SU(2)-invariant tensors leads to a shorter time per iteration 
of the optimization algorithm. In the symmetric versions of 
the algorithm we considered precomputation of repeated op- 
erations, see App. C. 



V. SUMMARY AND OUTLOOK 

In this paper we have addressed the theoretical and imple- 
mentation aspects of incorporating a global SU(2) symmetry 
into tensor network algorithms. On the theoretical side we de- 
scribed how SU(2)-invariant tensors decompose in a compact 
canonical form that is made of two terms - degeneracy tensors 
that are unconstrained by the symmetry and intertwiners of 
SU(2) that are completely determined by the group. We ex- 
plained how a set of primitive tensor manipulations (reversal, 
permutation and reshape of indices and matrix multiplication 
and matrix factorizations) are adapted to the canonical form 
of SU(2)-invariant tensors. To this end we introduced certain 
transformations (listed in Table I), determined completely by 
the symmetry group, that play an instrumental role in the 
manipulation of SU(2)-invariant tensors. 

On the implementation side we described (see App. C) 
a practical scheme to implement SU(2) symmetry into ten- 
sor network algorithms. This scheme is based on organizing 
the non-trivial components of an SU(2)-invariant tensor into 
an SU(2)-invariant vector. A highlight of this approach is 
that the reversal, permutation and reshape of indices of an 
SU(2)-invariant reduce to matrix operations, specifically, the 
multiplication of an SU(2)-invariant matrix and vector. 

Finally, we described the SU(2)-invariant MERA and used 
it to demonstrate how incorporating the symmetry allows for 
the selection of total spin and also the significant reduction of 
computational costs (by a factor of between forty and fifty). 
These gains may be used either to reduce overall computation 
time or to permit substantial increases in the MERA bond 
dimension x, and consequently in the accuracy of the results 
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obtained. 

Though we have focused on SU(2) symmetry, the formal- 
ism presented here may equally well be applied to any non- 
Abelian group that is compact, completely reducible and mul- 
tiplicity free. In particular, one can consider composite sym- 
metries such as SU(2)xU(l), corresponding to spin isotropy 
and particle number conservation, and SU(2) xSU(2), cor- 
responding to conservation of spin and isospin, etc. Such 
a composite symmetry is characterized by a set of charges 
(ai, 02, as, . . .). When fusing two such sets of charges 
(ai , a2 , oa , . . . ) and (a'l , 02 , 03 , . . . ) , each charge a; is combined 
with its counterpart according to the relevant fusion rule. 
Once again, this behaviour may be encoded into a single fuse 
tensor "f 

On the other hand, our formalism can be extended to non- 
Abelian groups e.g. SU(3) where inner and/or outer mul- 
tiplicity appears in the representations of the group. In the 
present formalism, inner multiplicity corresponds to the oc- 
currence of multiple states with the same value of ruj for a 
given j. This can be accounted in a straightforward way by 
replacing the existing label mj with the pair {mj,pj) where 
the additional label pj £ {1, 2, . . .} allows distinction between 
states with inner multiplicity. The label Pj does not appear 
on the degeneracy tensors, nor do the F and R coefficients 
depend on pj. However, this is not the case with outer mul- 
tiplicity. Outer multiplicity corresponds to the occurrence of 
multiple copies of the same irrep j in the tensor product of 
two irreps (fusion rules). In this case Ea. (fB40|) is replaced 
with 

V^l'^v'f -0Mf^)®Vf^', (52) 

where M^'*^'' is the (outer) multiplicity space of irrep j. 
In order to account for this multiplicity we replace j with 
the pair {j,qj) throughout the discussion, where qj £ 
{1,2,..., dim(M^'*^')} labels different copies of j in the de- 
compositions (|52p . 

Our formalism can also be extended to incorporate more 
general symmetry constraints such as those associated with 
conservation of total fermionic and anyonic charge. We pro- 
ceed by defining the transformations listed in Table I for the 
relevant charges. As an example, consider fermionic con- 
straints where the relevant charge, p, is the parity of fermion 
particle number. Charge p takes two values, p — and p = 1 
corresponding to even or odd number of fermions. The fuse 
tensor T '""^ encodes the fusion rules that specify how charges 
p and p' fuse together to obtain a charge p" . These correspond 
to the fusion rules for the group Z2, given as, 





p' = 


p' = l 


p = 


p" = 


p" = l 


p = l 


p" = l 


p" = 



The recoupling coefficients F^lp2plpi^ associated with the 
fusion of three charges pi , p2 and ps are simple in this case ow- 
ing to the Abelian fusion rules. They take value F^Ip^pIpa ~ ^ 
for all values of intermediate charges pi2 and P23 that appear 
when fusing the three charges one way or the other. The fi- 
nal ingredient is the tensor i^™"? with components R^TZ^pm 
which in this case is defined as, 

Tp swap -1 Tp swap -1 73 swap -1 73 swap -1 

^0,0^0 ~ ^' ^0,1^1 ^ ^5 ^1,0-»1 ^ ^l,l-»0 ^ 



In a similar way, one can encode the corresponding fu- 
sion rules for anyonic charges into the fuse tensor X'""". 
For anyonic charges, the recoupling coefficients F are ob- 
tained as solutions to the pentagon equations whereas the 
tensors /J=™p are replaced with the anyonic braid genera- 
tors that are obtained as solutions to the hexagon equations, 
see Refs. 35 91 92. Thus, having defined these tensors for 
the relevant charges, the formalism and the implementation 
framework presented in this paper can be readily adapted to 
incorporate the constraints corresponding to the presence of 
fermionic or anyonic charges. 
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Appendix A: Tensor network formalism 

In this appendix we review the basic formalism of tensors 
and tensor networks. Even though we do not make any ex- 
plicit reference to symmetry here, our formalism is directed 
towards SU(2)-invariant tensors. 



1. Tensors 

A tensor T is a multi-dimensional array of complex num- 
bers Tij^i2...ik- The rank of a tensor is the number k of indices. 
For instance, a rank-0 tensor {k = 0) is a complex number. 
Similarly, rank-1 {k = 1) and rank-2 {k = 2) tensors cor- 
responds to vectors and matrices, respectively. The size of 
an index i, denoted is the number of values that the in- 
dex takes, i £ 1, 2, . . . , Each index ii, I — 1,2, . . . ,k, oi 
the tensor is also equipped with a direction: 'in' or 'out', 
that is, either incoming into the tensor or outgoing from 
the tensor respectively. The size of a tensor T, denoted 
|r|, is the number of complex numbers it contains, namely, 
|r| = X |z2l X ... X \ik\. 

It is convenient to use a graphical representation of tensors, 
as illustrated in Fig. 1, where a tensor is depicted as a "blob" 
(or by a shape e.g., circle, square etc.) and each of its indices 
is represented by a line emerging perpendicular to the bound- 
ary of the blob. Each line carries an arrow that indicates 
the direction of the corresponding index. By convention, all 
arrows in a diagram point downward in the page. Therefore 
arrows are redundant. Nonetheless we draw them explicitly 
to emphasize the direction. In order to specify which index 
corresponds to which emerging line, we follow the prescription 
that the lines corresponding to indices {ii, 12, ... , ik} emerge 
in counterclockwise order. The first index corresponds to the 
line emerging closest to a mark (black dot) inside the bound- 
ary of the blob (or to the first line encountered while pro- 
ceeding counterclockwise from nine o'clock in case the tensor 
is depicted as a circle without a mark). 



2. Elementary manipulations of a tensor 

A tensor can be transformed into another tensor in several 
elementary ways. These include, reversing the direction of 



(a) b (b) a 




d 
c 



FIG. 19: (Color online) Graphical representation of tensors by 
means of a shape e.g. circle or a "blob". Indices of the tensor 
correspond to lines emerging perpendicular to the boundary 
of the shape. Indices may be incoming or outgoing as indi- 
cated by arrows, (a) Graphical representation of tensors with 
rank 0, 1 and 2, corresponding to a complex number c £ C, 
a vector \v) € C'"' and a matrix M G C^'^^^W. (b) Graphi- 
cal representation of a tensor T with components Tabcd and 
directions D = {'in', 'out', 'in', 'out'}. Indices emerge in a 
counterclockwise order, the first index is the one emerging 
closest to a mark (dot) inside the blob. By convention all 
arrows in a tensor diagram point downward in the page. 



one or several of its indices, permuting its indices, and/or 
reshaping its indices. 

Reversing an index corresponds to creating a new tensor 
T' from T by flipping the direction of the index e.g. 

{f'Uo = fabc, (Al) 

where a denotes the index that is obtained by reversing the 
direction of a, and T' is component-wise equal to tensor T. 
Reversal of an index is depicted [Fig |20r al] by "bending" the 
line corresponding to the index upward if the index is outgoing 
or downward if it is incoming (since we allow arrows to point 
only downward). In this paper, we will use the terminology 
"reversing an index" and "bending an index" interchangeably. 

A permutation of indices corresponds to creating a new 
tensor T' from T by simply changing the order in which the 
indices appear, e.g. 

{f')bac = fabc (A2) 

Permutation of indices is depicted by intercrossing the lines 
corresponding to the indices, as illustrated in Fig |20f b). A 
cyclic permutation of indices e.g. {T')cab = Tabc can also be 
depicted by simply shifting the starting mark (black dot) to 
a new location within the blob instead of intercrossing lines, 
FigOSIc). 

A tensor T can be reshaped into a new tensor T' by "fusing" 
and/or "splitting" some of its indices. For instance, in 

(rOdc = fabc, d = axh, (A3) 

tensor T' is obtained from tensor T by fusing indices a G 
{1, ■ • ■ , |a|} and b G {1, • ■ ■ , \b\} together into a single index d 
of size \d\ = \a\ ■ \b\ that runs over all pairs of values of a and 
b, i.e. d € {(1, 1), (1, 2), • ■ • , (|a|, |6! - 1), (|a|, |6|)}, whereas in 

fabc = {f')dc, d = axb, (A4) 

tensor T is recovered from T' by splitting index d of T' back 
into outgoing indices a and 6, see Fig |20l' d)-(e). 

Though the direction of an index appears to be of limited 
relevance here, Eq. (|Al|l . it will play an important role when 
we consider SU(2)-invariant tensors where it specifies how the 
group acts on that index. In particular, directions have to be 




(b) c c (c) c c 

b a a b a b 

(d) c c c c 

d d=axb ^ b a b 

FIG. 20: (Color online) Transformations of a tensor: (a) Re- 
versing the direction of an index, Ea. (|AH) . is depicted by 
bending lines, (b) Swapping two outgoing indices, Ea. (|A2|) . 
(c) Cyclic permutation of indices, e.g. {T')cab = Tabc, is de- 
picted by simply shifting the starting mark (black dot) close 
to the first index of the resulting tensor, (d) Fusion of indices 
a and b into d — a x b, Ea. (jA3|) : splitting of index d — a x b 
into a and b, Ea. (|A4|l . 



carefully considered when permuting and reshaping indices 
that have different directions. 

For example, consider a rank-3 tensor T with outgoing in- 
dices a and 6 and incoming index c and let T' denote the 
tensor obtained from T by permuting its indices as {T')acb = 
Tabc- Notice that, in order to intercross the lines correspond- 
ing to b and c in the corresponding graphical representation 
we first have to bend c downward, then intercross c and b 
and bend back c upward, see Fig |21f aV (Alternatively, we 
could bend b upward, intercross b and c, and then bend back 
b downward.) This graphical example motivates the decom- 
position of an arbitrary permutation of indices into a sequence 
of reversal of indices and swaps, where a swap corresponds to 
interchanging the position of two adjacent indices with the 
same direction [Fig[20jb)]. 

Analogously, the fusion of an incoming and an outgoing 
index corresponds to first bending, say, the incoming index 
downward and then fusing it with the outgoing index, as il- 
lustrated in Fig |2ir b). In this case, the original tensor is 
recovered by splitting back the fused index and then bending 
the index that was initially incoming. These decompositions 
of permutations and reshapes into more basic steps involving 
bending of lines will appear more relevant and more useful 




FIG. 21: (Color online) (a) Swapping an incoming and out- 
going index as decomposed into two reversals and a swap, (b) 
Fusion of an incoming and an outgoing index as decomposed 
into a reversal and a fusion of outgoing indices. 
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FIG. 22: (Color online) (a) Graphical representation of the 
matrix multiplication of two matrices R and S into a new ma- 
trix T, Eq. (|A5|) . (b) Graphical representation of an example 
of the multiplication of two tensors R and S into a new tensor 
f, Eq.JMl). 

in the context of SU(2)-invariant tensors where bending lines 
corresponds to transforming the tensor in a non-trivial way. 



3. Multiplication of two tensors 

Given two matrices R and S with components Rat and 
Sbc, we can multiply them together to obtain a new matrix 
T, T = R ■ S , with components 

fac = Yl R'^bSbc, (A5) 
b 

by summing over or contracting index b. The multiplication 
of matrices R and S is represented graphically by connecting 
together the emerging lines of R and S corresponding to the 
contracted index, as shown in Fie: l22f al. 

Matrix multiplication can be generalized to tensors, such 
that, an incoming index of one tensor is identified and 
contracted with an outgoing index of the other. For in- 
stance, given tensor R with components Rabcde and directions 
{'in', 'out', 'in', 'out', 'out'}, and tensor 5* with components 
Scdfbg and directions {'out', 'in', 'in', 'in', 'out'}, we can de- 
fine a tensor T with components Tafeg that are given by 




FIG. 23: (Color online) Graphical representations of the five 
elementary steps 1-5 into which one can decompose the mul- 
tiplication of the tensors of Eq. (|A6[) . 



as outgoing indices, 

(^R )ae bed i^R^ abodes 

(SX^djg = (S)cdfbg. (A7) 



Tafeg ~ Rabcde Scdfbg ■ (^6) 

bed 

Note that each of the indices b, c and d that are contracted 
is incoming into one tensor and outgoing from the other. 
The multiplication is represented graphically by connecting 
together the lines emerging from R and 5* corresponding to 
each of these indices, as shown in Fig[22jb). 

Multiplication of two tensors can be broken down into a se- 
quence of elementary steps by transforming the tensors into 
matrices, multiplying the matrices together, and then trans- 
forming the resulting matrix back into a tensor. Next we de- 
scribe these steps for the contraction given in Eq. (|A6|l . They 
are illustrated in Fig[23] 

1. Reverse and Permute the indices of tensor R in such 
a way that the indices b, c and d that are contracted 
appear in the last positions as outgoing indices and in 
a given order, e.g. bed, and the remaining indices a 
and e appear in the first positions as incoming indices; 
similarly reverse and permute the indices of S so that 
the indices b, c and d appear in the first positions as 
incoming indices and in the same order, bed, and the 
remaining indices / and g appear in the last positions 



2. Reshape tensor R' into a matrix R" by fusing into a 
single index u all the indices that are not contracted, 
u = a xe, and into a single index y all indices that are 
contracted, y = b x c x d; similarly reshape tensor S' 
into a matrix 5"' with indices y and w = f x g {in order 
to obtain the same index y, the three indices b,c and 
d are fused according to the same sequence of pairwise 
fusions for both the tensors as shown in the figure), 

{R ^uy ~ {R )a~6cd; 

{S")y^ = {S')b-^,j,. (A8) 

3. Multiply matrices R" and S" to obtain a matrix T' with 
components 

(T").™ = ^(i?")u. (S").». (A9) 
y 

4. Reshape matrix T" into a tensor T' by splitting indices 
u — a xe and w — f x g, 
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FIG. 24: (Color online) (a) Factorization of a matrix T ac- 
cording to a singular value decomposition, Eq. (|A12| ). (b) Fac- 
torization of a rank-4 tensor T according to one of several 
possible singular value decompositions. 

5. Reverse and Permute indices of tensor T' in the order 
in which they appear in T, 

fafe, = (T\^7,. (All) 

The contraction of Ea. (|A6|) can be implemented at once, with- 
out breaking the multiplication down into elementary steps. 
However, it is often more convenient to compose the above 
elementary steps since, for instance, in this way one can use 
existing linear algebra libraries for matrix multiplication. In 
addition, it can be seen that the leading computational cost 
in multiplying two large tensors is not changed when decom- 
posing the contraction in the above steps. 



4. Factorization of a tensor 



(a) d (b) d 




FIG. 25: (Color online) (a) Example of a tensor network A/", 
(b) Tensor T of which the tensor network A/" could be a rep- 
resentation, (c) Tensor T can be obtained from A/" through a 
sequence of contractions of pairs of tensors. Shading indicates 
the two tensors to be multiplied together at each step. The 
product tensor at each step is conveniently depicted by the 
blob that covers the two tensors that are multiplied. 

reversing directions, permuting and reshaping the indices of 
T to form a matrix, then decomposing the latter, and finally 
restoring the open indices of the resulting matrices into their 
original form by undoing the reshapes, permutations and re- 
versal of directions. 



A matrix f can be factorized into the product of two (or 
more) matrices in one of several canonical forms. For instance, 
the singular value decomposition 

fab = UacScdVdt = UacScVcb (A12) 

c,d c 

factorizes T into the product of two unitary matrices U and V , 
and a diagonal matrix S with non-negative diagonal elements 
Sc = Sec known as the singular values of T [Fig[24][a)]. On 
the other hand, the eigenvalue or spectral decomposition of a 
square matrix T is of the form 

fab = ^A/a,D,d(M-')di, = Y,MaAc{M~^)cb (A13) 

c,d c 

where M is an invertible matrix whose columns encode the 
eigenvectors |Ac) of T, 

f\Xc) = Ac|A,), (A14) 

is the inverse of M , and _D is a diagonal matrix, with the 
eigenvalues Ac = -Dec on its diagonal. Other useful factoriza- 
tions include the LU decomposition, the QR decomposition, 
etc. We refer to any such decomposition generically as a ma- 
trix factorization. 

A tensor T with more than two indices can be converted 
into a matrix in several ways by specifying how to join its in- 
dices into two subsets. After specifying how tensor T is to be 
regarded as a matrix, we can factorize T according to any of 
the above matrix factorizations, as illustrated in Fig[24jb) for 
a singular value decomposition. Generally, this requires first 



5. Tensor networks and their manipulation 

A tensor network A/" is a set of tensors whose indices are 
connected according to a network pattern, e.g. Fig |25l 

Given a tensor network A/", a single tensor T can be ob- 
tained by contracting all the indices that connect the tensors 
in N [Fig[25jb)]. Here, the indices of tensor T correspond to 
the open indices of the tensor network A/". We then say that 
the tensor network A/" is a tensor network decomposition of 
T. One way to obtain T from M is through a sequence of 
contractions involving two tensors at a time [Fig |25f c')]. No- 
tice how a tensor that is obtained by contracting a region of 
a tensor network is conveniently depicted by a blob or shape 
that covers that region. 

From a tensor network decomposition M for a tensor T, 
another tensor network decomposition for the same tensor T 
can be obtained in many ways. One possibility is to replace 
two tensors in N with the tensor resulting from contracting 
them together, as is done in each step of Fig |25f c'). Another 
way is to replace a tensor in M with a decomposition of that 
tensor (e.g. with a singular value decomposition). In this 
paper, we will be concerned with manipulations of a tensor 
network that, as in the case of multiplying two tensors or 
decomposing a tensor, can be broken down into a sequence of 
operations from the following list: 

1. Reversal of direction of indices of a tensor, Eg. dAlll . 

2. Permutation of the indices of a tensor, Eq. (|A2[) . 

3. Reshape of the indices of a tensor, Eqs. HA3|) - (|A4I) . 

4. Multiplication of two matrices, Eq. (|A5|) . 
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5. Factorization of a matrix e.g. singular value decompo- 
sition Ea. (|A12|) or spectral decomposition Eq. (|A13[ ). 

These operations constitute a set V of primitive operations 
for tensor network manipulations (or, at least, for the type of 
manipulations we will be concerned with). In Sec. IIIII (and 
also in App. [C] we discuss how this set V of primitive oper- 
ations can be generalized to tensors that are invariant under 
the action of the group SU(2). 



6. Tensor network states for quantum many-body 

systems 

Tensor networks are used as a means to represent the wave- 
function of certain quantum many-body systems on a lattice. 
Let us consider a lattice C made of L sites, each described 
by a complex vector space V of dimension d. A generic pure 
state 1 5') G V®^ of C can always be expanded as 



I*) 



,|ii)|i2) • ■ • \iL), 



(A15) 



the following way. Let us use index i of the tensor to label a 
basis \i) of a complex vector space V'*' = C'*' of dimension 
Then a rank-one tensor with an outgoing index i represents 
a vector in V'*^ or alternatively a linear map from V'*' to C. 
Analogously, a rank-two tensor T with an incoming index a 
and an outgoing index b represents a matrix or equivalently 
a linear map f : (V<"^)* ® V*''^ C where (¥<"')* is the dual 
of vector space V'°' . 

More generally, we can use a rank-A: tensor T to define a 
linear map from the tensor product of k vector spaces to C 
in the following way. Define a set W<*'>, I = 1,2, . . . ,k, ol k 
spaces, 

^in)_[ V(''' if 5(0 = 'out', 
^ -\(V('^))- if 5(0 = 'in', 

where the (V'*'')* is the dual of vector space V^''' and D 
denotes the directions associated with the indices of tensor 
T, namely, D{1) = 'in' if ii is an incoming index and D{1) = 
'out' if ii is outgoing. Then tensor T can be regarded as the 
linear map 

f : (S?)W<''' C. (A17) 



where is = 1, - • • ,d labels a basis \is) of V for site s £ C. 
Tensor with components ^'i^ij- -iii contains complex 
coefficients. This is a number that grows exponentially with 
the size L of the lattice. Thus, the representation of a generic 
pure state |^) £ V®^ is inefficient. However, it turns out 
that an efficient representation of certain pure states can be 
obtained by expressing tensor "I* in terms of a tensor network. 
Popular tensor networks such as the MPS, PEPS, TTN and 
the MERA correspond to decomposition of tensor 'i' into a set 
of tensors that are interconnected according to a given net- 
work pattern. The open indices of each of these tensor net- 
works correspond to the indices ii, 12, ■ • • , ii of tensor 'P. All 
these tensor networks contain 0{L) tensors. If p is the rank of 
the tensors in one of these tensor networks, and x is the size 
of their indices, then the tensor network depends on 0{Lx^) 
complex coefficients. For a fixed value of x this number grows 
linearly in L, and not exponentially. It therefore does indeed 
offer an efficient description of the pure state I'l') G V®^ that 
it represents. Of course only a subset of pure states can be 
decomposed in this way. Such states, often referred to as ten- 
sor network states, are used as variational ansatze, with the 
0{Lx^) complex coefficients as the variational parameters. 

Given a tensor network state, a variety of algorithms (see 
e.g. Refs. fillip are used for tasks such as: (i) computation of 
the expectation value {4'|oj^) of a local observable 6, (ii) op- 
timization of the variational parameters so as to minimize the 
expectation value of the energy or (Hi) simulation of 

time evolution, e.g. e~'^*|>I'). These tasks are accomplished 
by manipulating tensor networks. 

On most occasions, all required manipulations can be re- 
duced to a sequence of primitive operations in the set V intro- 
duced in Sec. lA 51 Thus, in order to adapt the tensor network 
algorithms of e.g. Refs. [lll46l to the presence of a symmetry, 
we only need to modify the set V of primitive tensor network 
operations. This will be done in Sec. IIIII 



7. Tensors as linear maps 

A tensor can be used to define a linear map between a 
tensor product of vector spaces and complex numbers, C, in 



In this view, a tensor network Af can be regarded as a compo- 
sition of linear maps - namely, one linear map for each tensor 
in A/". Manipulations of a tensor network, namely, reversal, 
permutation and reshaping of indices of tensors can also be 
interpreted as linear maps. For instance, reversal of an index 
of a tensor corresponds to mapping the vector space that is 
associated with the index to its dual - e.g. in Eq. (|A1|) . if in- 
dex a is associated to a vector space V'"' , then index a that 
is obtained by reversing the direction of a is associated with 
the dual space (V<">)*. 



Appendix B: Representation theory of the group 
SU(2) 

In this appendix we review basic background material con- 
cerning the representation theory of the group SU(2). We first 
consider the action of SU(2) on a vector space that is an irre- 
ducible representation of the group and then more generally 
on a vector space which decomposes as a direct sum of (possi- 
bly degenerate) irreducible representations. We then consider 
vectors in such a space that are invariant under the action of 
SU(2) as well as linear operators that are SU(2)-invariant. 
Then we consider the action of SU(2) on the tensor product 
of two irreducible representations and also on two reducible 
representations, and its generalization to the tensor product 
of an arbitrary number of representations. (In this appendix 
we also introduce the transformations that play an instru- 
mental role in adapting the set V of primitive tensor network 
manipulations to the presence of the symmetry [Sec. IIII) . see 
Table I.) 



1. Irreducible representations 

Let V be a finite dimensional vector space on which the 
group SU(2) acts by means of unitary transformations Wr, 



WiW, = WrWi = 1, Vr G 



Vri,r2 e : 



(Bl) 
(B2) 
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where r 



(r 



parameterizes the elements of form a basis of ' 



SU(2). The transformations Wr are a representation of the 
group SU(2), which is generated by hermitian operators J^, Jy 
and that close the lie algebra su(2), namely, 



7 — X ,y ,2 



= x,y,z, 



(B3) 



where £0/37 is the Levi-Civita symbol. In terms of the opera- 
tors Ja the transformations Wr read 



In this basis operators Ja and read as 
/O 




— ^/2 ^ s/2 \ - = ^/2 



J. = 






'75 




(B12) 



Wr 



(B4) 



If V transforms as an irreducible representation (or irrep) 
of SU(2) with charge j € {0, |, 1, |, 2, . . .} it has dimension 
Aj = 2_; + 1. For concreteness, in this paper we identify 
the charge j as labeling the angular momentum or spin and 
the operators Jx, Jy and Jz with the projection of spin along 
the three spatial directions x,y and z. We denote by \jmj) 
vectors that form an orthonormal basis of V and which are the 
simultaneous eigenvectors of the operator = + + 
and Jz. That is, 



Jz\jmj) = mj\jmj), 



(B5) 
(B6) 



where rrij £ {—j, — j + 1, ■ • • ,j} is the spin projection along 
the z direction. In the basis \ jmj) the action of the operators 
Jx and Jy is conveniently described in terms of the raising 
operator J+ — Jx + iJy and the lowering operator J- = Jx ^ 



J±\jm,) = VJU + i)-m,{m,±l)\j, [m, ± 1)). (B7) 

Example Bl. Vector space V that is a spin j = irrep of 
SU(2) has dimension one i.e. V = C and the operators Ja 



are trivial, Jx 



J V 



J. 



(0). 



Example B2. Consider a two-dimensional vector space V 
that transforms as an irrep j ~ ^- Then the orthogonal vec- 
tors (in column vector notation) 



1 



-,mi 



j = i,mi=i), (B8) 



2 2 2 \0J 2 2 2 

form a basis of V. In this basis operators Ja and read as 

'0 



J V 



Or in terms of Pauli matrices a 







X, y, z. 



(B9) 



(BIO) 



Example B3. Consider a three-dimensional vector space 
that transforms as an irrep j = 1. The orthogonal vectors 



2. Reducible representations 

More generally, SU(2) can act on a vector space V re- 
ducibly, in that, V may decompose as the direct sum of irreps 
of SU(2), 

(B13) 



e 



Here space Vj accommodates a spin j irrep of SU(2) and dj is 
the number of times Vj appears in the decomposition. The de- 
composition can also be written in terms of a dj -dimensional 
space Dj, 



0(1 



(B14) 



We say that irrep j is dj-fold degenerate and that Dj 
degeneracy space. The total dimension of space V is 

dim( V) ^^dj Aj , Aj =2j + l. 



is the 



(B15) 



Let tj — 1,2, ...,dj label an orthonormal basis \jtj) in the 
degeneracy space Dj. Then a natural choice for a basis of 

V is the set of orthonormal vectors \jtjmj} = \jtj) ® \jmj), 
where j assumes various values that occur in the direct sum 
decomposition Eq. (|B14| ). In this basis the action of SU(2) on 

V is given by 

Wr = ^[id,0Wr,,), (B16) 

j 

as generated by the operators 



— 



Ja, 



x,y,z, 



(B17) 



where Jaj now denote (with an explicit subscript j) the gen- 
erators of the spin j irreducible representation Wr.j : Vj — > Vj 
and Id is the dj x dj Identity matrix. 

Example B4- Consider a vector space V of dimension six 
that transforms as an irrep j ~ ^ with a finite degeneracy 

di = 3. It decomposes as V = (Dj_ (g) Vi ), where Di is a 

2 222 
three-dimensional degeneracy space and Vi corresponds to 

the space of Example B2. The vectors \ jtj), 



|j = l,mi = -l), 



|j = l,mi = 0), 



|j =-,io=l), 



|j =-,to=2). 



|j = l,mi = l), 



(Bll) 



= 1.7 = 2'*i = 3)' 



(B18) 
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form a basis of Di and the vectors \jmj) of (|B8P form a basis 
of Vi. Then in the basis \jtj} ® Umj) of V the operators 
J„ : V -i^ V take the form of Ea. (fBT7| . that is, 




/O I 0\ 
'^ 0' 







I 

0^000 

i 

Vo i o/ 



(B19) 



Similarly we have 



2 






-f 









\0 























1 



1 








1 







Vo 







_ i 
2 





-1/ 



(B20) 



The operator reads 



I 




0\ 



1 











I 
Vo §/ 



(B21) 



Example B5. Consider a five-dimensional Hilbert space V 
that decomposes into two different irreps j = Q and j = 1 
with degeneracy do = 2 and di = 1 respectively so that irrep 
j — is two-fold degenerate. The space V decomposes as 
V = (Do (g) Vo) © (Di (g) Vi), where Do is the two-dimensional 
degeneracy space of irrep j = and Di is the one-dimensional 
degeneracy space of irrep j = 1. The orthogonal vectors 



' 




Vi/ 




' 





Vo/ 




Vo/ 



\j = 0,to = l,mo = 0), 



li = 0, to = 2,7710=0), 



= \j = l,ti^ I, mi = -1), 



= \j = l,ti = I, mi = 0), 



' 




Vo/ 



\j = l,ti^ I, mi = 1), 



(B22) 



form a basis of V. In this basis the operators Ja take the form 

Ja = {ho ® Ja,o) ® {hi ^ Ja,l)> Of = 2;, y, 2, (B23) 

where Ja,o and are operators that generate irrep j = 
(Example Bl) and irrep j — 1 (Example B3) respectively. 
Operators Ja and read as 



/O 




\0 

/O 




\0 






1 

72 







i 

V2 









1 



1 




i 

75 


i 

V2 

' 




-1/ 







1 

72 

0/ 



- 





_ i 





/O 

'o 

10 



Vo 



/O 0\ 

' ' 

2 

2 

Vo 2/ 



(B24) 



3. Invariant states and operators 

In this paper we are interested in states and operators that 
are invariant under the action of SU(2). 

A pure state |^') £ V is invariant if it transforms trivially 
under the action of SU(2), 



V|/r|*) = l*), Vre 



(B25) 



Equivalently, the state is annihilated by the action of the 
generators [Ea. (|B4p ] 



(B26) 



Jal*) =0, a = x,y, z, 

and therefore also by the operator J^, 
J^l*) = 0. 



(B27) 



This implies that l^*) corresponds to a pure state with j = 
and m = 0. Thus, it can be expanded in the basis {\j — 
0, to,mo = 0)} of the subspace (Do ® Vo) C V, 



do 



I*) = X](*o)t„|j = 0,to,mo = 0), 



(B28) 



where we have used (*I'o)to as a shorthand for (\I'j^o)to.™o=o 
and do is the dimension of the degeneracy space Do. 
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A linear operator T : V — >■ V is SU(2)-invariant if it com- 
mutes with the action of the group, 

[f,Wr]^0, VrGR^ (B29) 

or equivalently, if it commutes with the generators Jq, 

[f,J^]=0, a = x,y,z. (B30) 

According to Schur's lemma, an SU(2)-invariant operator T 
decomposes as 



(B31) 



where Tj is a x dj matrix that acts on the degeneracy space 
and /2j+i is the (2j + 1) x {2j + 1) Identity matrix acting 
on the irrep Vj. This decomposition implies, for instance, 
that operator T transforms pure states belonging to the spin 
j subspace to pure states within the same subspace. Thus, 
SU(2)-invariant operators conserve spin(j). 
Example B6. Using Eq. (|B3|l it follows that 



[J , e/a 



0, 



that is, the operator — Ja is SU(2)-invariant and has 
the form (fBSTj) . as can be verified in Examples B2-B5. In 
particular, for an irreducible representation j we have 



: j{j + 1)/2,H 



(B32) 



Example B7. An SU(2)-invariant mixed state in a vector 
space V is described by a density matrix p ; V — > V that is an 
SU(2)-invariant operator. That is, 

[p, Ja]=0, a = x,y,z. (B33) 

Note that in the decomposition (IB31|I of p, j may also take 
values different from zero (while an SU(2)-invariant pure state 
corresponds to only j = 0). 

Example B8. A generic state I*!') in the vector space V = 
2Vo © Vi of Example B5 has the form 



/ (*o)i,o \ 

(*0)2,0 ' 
(*l)l,-l 
(*l)l,0 
\ (*l)l,l / 



(B34) 



where we have used (^o)i,o, for instance, as shorthand nota- 
tion for (^'j=o)to=i,mo=o and so on. Clearly, \^) is generally 
not a state with j = 0, and thus not SU(2)-invariant. An 
SU(2)-invariant vector \^o) has the form 



l*o) 



/(*o)i,o\ 

(*o)2,0 







(B35) 



with non-trivial components only in the spin j = subspace. 
Notice that this state is annihilated by the action of the op- 
erators Ja of Ea. HB24p in accordance with Ea. (|B26 |l. Analo- 
gously a state with a well defined spin j = 1 must be of the 
form 



l*i> 





(*i)i.o 
(*i)i,i 



(B36) 



with non-trivial components only in the spin j = 1 subspace. 
An SU(2)-invariant operator T : V — ^ V has the form 



T - 



(To),, (To),, 
(To) 21 (10)2; 

/(To)n (To)i2 



/l 0^ 

(1)® ((ri)ii)® 10 
\0 Ij 






\ 



(To) 22 














(B37) 



where (To),,, {To),^, {To)^,, (To).,^ , (Ti),, G C. 



Notice that an SU(2)-invariant vector e.g. I'I'o) of Ea. (|B35|) 
and an SU(2)-invariant matrix e.g. T of Ea. (IB37[) have a 
sparse structure, that is, several components are identically 
zero. In particular, the non-trivial components of the 
SU(2)-invariant matrix T are organized into blocks Tj. This 
structure can be exploited to store T compactly in memory 
by only storing the blocks Tj. Moreover, multiplication and 
factorizations of an SU(2)-invariant matrix can be performed 
block-wise (as described in Sec. IIII|) resulting in a significant 
computational speedup (see Fig ll3l) for these operations. 
Our strategy for exploiting the symmetry in the context 
of tensor network algorithms is based on identifying the 
analogous sparse block structure for generic SU(2)-invariant 
tensors, as is described in Section [Till 



4. Tensor product of two irreducible 
representations 

Let V'-*' and V<^^ be two vector spaces which carry irreps 
Ja and Jb of SU(2) as generated by spin operators ,7^^^ and 
Ja^' . Also consider the action of SU(2) on the tensor product 
space V'-*^' = V*^' (g) V^^^ that is generated by the total spin 
operators 

J<^^) EE j'-^) ® J-f J® a = x,y,z, (B38) 

and which corresponds to the unitary transformations, 

W^r ' = e ') ^ (B39) 

The space V''^^' is in general reducible and decomposes as 
V(Afl) ^0V<;^s)_ (B40) 



where the total spin jab assumes values \ jA — 3b\, 1 ja — is] + 
I,---, JA+JB. 

Introduce a coupled basis jjAsn^As) in V'-^^' given by 



J^*'^^'|jABmj^^) =jAB{jAB + i)\jABmj^g), 

Ji^^^ IjABnij^s) =mj^^ IjABrUj^^), 



(B41) 



where J 



2(AB) 



j2(AB) 



If \jAmA) and |jsms) denote 



the basis of spaces V'-*' and V'-^' then the coupled basis 
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\jABmAB) is related to the product basis \jAmjj^;jB'mjg) = 
IjAmj^) (g) \ jBmjg) by means of the transformation 



\jABmj^g) ^ ^ C'ja™,^ 



\jAmj^\jBmjg), 



(B42) 



where C/7^^.^,jg„^^^j^g„^.^^ are the Clebsch-Gordan coef- 
ficients of SU(2). These coefficients are real and are identi- 
cally zero unless the j's and the m's fulfill 



\jA - jsl <jAB <jA +jB, 



(B43) 
(B44) 



We say that JajJb and j^s are compatible if they satisfy the 
above inequality. 

The product basis can in turn be expressed in terms of the 
coupled basis as 



(B45) 



where 

split y^fuSC 

(B46) 

The basis \ jABmjj^g) is orthonormal and complete. Then 
it follows that 



JAB-^iji 



^ split 

3Am..i^,3Bm..i^^3ABmj^g ' ^j^^ "ij^s ™j/ .i^ 



split 
iAB™3 



^B^J^^iA'JB^JB ' '~'iAm,^,3Bmjg~*3'AB"^i' 



- ^3AB3'ab^"^JAb"^j 



(B48) 



The change of basis HB45|I [and also (IB42I) ] is related in a 
simple way to the corresponding change of basis with spaces 
V'-*) and V(^) swapped as 



^ split 



JABllj^B ^JB^lj^ JAIlj^ 3A,3b^3A 



^1 split 

jAB^jj^g^jA^jj^jB^-jg ' 



(B49) 

where the factor RJ^'jg^jj^g depends only on the value of 



the j's, 



(B50) 



The graphical representation of the transformations (7^"°° 
and (7=p''' is shown in Fig |26f a). Note the arrangement of ar- 
rows and the order in which indices (ja, nij^ ), (j'b, mj^ ) and 
{jAB , mjAB ) S'l's assigned to the three lines in the graphical 
representations of (7*"°" and (7=p'''. This graphical represen- 
tation allows for an intuitive depiction of Eas. HB47|l - (|B49|) . as 
shown in FiglMbVfd). 

Example B9. Consider two vector spaces V^'*' and V'^', 
both transforming as the spin ^ irrep, and let |ja = Ij'tIja) 
and I = 5 , "Tijg ) denote the spin basis in the respective 
spaces. The space V*'*'^' = V*^' ® V^^' decomposes as 



(a) 0.,mj (j„,mj (j.B.n^i..) (b) 



A Split 




(d) 



^Ja ■ Jb ^ Jab 



FIG. 26: (a) The graphical representation of the transforma- 
tions C"^"™ and C"P'". (b) Depiction of Ea. ((B47l) . The sum is 
over all values of ^ab (and nij^^ ) that are compatible with 
jA and jB. (c) Depiction of Eq. (|B48p . The identity holds for 
all compatible values of Ja , Jb , and Jab ■ Any contraction in- 
volving (7'"=° and (7=p''* corresponds to summing the m's and, 
if required, also the j's. We explicitly indicate a summation 
only when the j's are summed, (d) The tensor obtained by 
swapping indices (jajTIj^) and {jB,mjg) of tensor (7=p''* is 
proportional to another C""'"* tensor, Ea. (|B49|) . 



V(-4S) Yi^^^ e Vj^^\ The coupled basis |iAB,m,^s) of 
Y(ab)^ 

\jAB = 0,mjAg = 0), liAB = = -1), 

Ijab = l,?njAB = 0), IjAB = l,TnjAB = 1)> 
is related to the product basis, 

\JA = -,mj^-jB = -,mjg), 
by means of the Clebsch-Gordan coefficients, for instance, 

i JAB = 0, TTlAB = 0) = 
1 



, mA= 



jB=-,mB=-} 



2 2 ' 2 2 2 2 2 2 

where the numerical values of the Clebsch-Gordan coefficients 
can be read ofi^ from standard tables^-. Here we have 



Cfuse 1 y- Y fuse 



1 



2 2 ' 2 2 
~ ' 2 ~2 



CfuSG f fuse 

IZli — '^ii 11-^11 



' 2 2 ' 2 2 

ii° 1 _ 

2 2 ' 2 2 
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It can also be readily verified, for instance, that 



fuse \ I / ^ fuse 

2 2 ' 2 2 J \ 2 2 ' 2 2 



CT 



2 2 ' 2 2 



Cfusc 
1 1 1 ■ 



in accordance with Eas. (|B48|) - (|B49|l . 



5. Tensor product of two reducible representations 

More generally, consider vector spaces V'^-* and V'^' that 
transform reducibly under the action of SU(2). That is, they 
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decompose as 



The product space 



(AB) 



(B51) 



(A) ® decomposes as 

JAB iAE 



''^e^jAsKT^eK^Xs')^ (B52) 



where the degeneracy dj^g of a total spin Jab has a contri- 
bution from all pairs of irreps Ja and Jb that are compatible 
with it, that is, 



JAB 



0(D(f «D(f). (B53) 



Let IjAij^TTtj^) and IjBtjBi^jB) denote the spin basis of 
spaces V*-^' and V*-^' respectively. We can then introduce 
a coupled basis IjABtj^gTnj^g) in v'^^' that fulfills 

J^^^'^^ljABtj^gm.jj^g) = JabUab + i)\jABtjABmj^g), 
ii^^' IjABt-j^g-mj^s) ^ nij^s IjABtjj.s'mjAB)- (B54) 

and is related to the product basis 

IjAtj^mj^-jBtjgmjg) = IjAtj^rrij^) ® IjBtjginjg), 

by means of the transformation 



IjABtjAs'miAB) = 

5Z 51/ ^^Atj^m3_4,if3t3B™.j_B^JAf3t3_, 



IjAtj^Tnj^-jBtjBmj^). 



(B55) 

The coefficients Tjj^; ^ ^^t^^^^.^ can be 
expressed in terms of the Clebsch-Gordan coefficients as 



fuse 

JAt3_4 ■JB*. 



(B56) 



Let us explain how this expression is obtained. By definition 
we have 

'^JAtj^ rrij^ jBtjg rnj^ -^jABtj^^ ™-0 AB ~ 

{jABtj^s mj^g \jAtjj, TUj^ ■ jBtjs mjB ) • (B57) 



According to the direct sum decomposition HB52[I each vec- 
tor IjABtjj^^rrijj^g) belongs to the subspace ® ^jab''-' 
where it factorizes as 

\jABtjj^g'mj^g) = \ jABtjj,s) ® \3ABmj^g). (B58) 

Similarly, we can factorize vectors |jAtj^wtj_4) and 
jjfltj^mjg). Substituting these factorizations into Eq. (|B57P 
and re-arranging terms we obtain 

'""jAtj^mj^ jBtjg-nij^ ^ j ABt j ^b"^! AB 

= {jABtjAB IjAtjA ; JBtjg ) {jABrUj^g IjArUj^ ; jBrrijg } , 

\r fuse ^ 1 fuse 

— ^jAtjA 'iBtjg -^JABtjAB ^3A^jA jB^jg -^jAB^jAB ' 

(B59) 



(a) 0.,t,,m ) 0„t,,,m ) (j„t, ) (j,,tj U„,mJ (j,,mj 




eV 



J. Jb 



FIG. 27: The graphical representation of (a) the fuse tensor 
T'"^", Eq. (|B55|) and (b) the split tensor, Ea. (|B60|l , and their 
decomposition into X and C tensors, (c) Tensors T'""" and 
T are unitary and thus yield the Identity when contracted 
pairwise as shown. The sum is over all the j's (and implicitly 
over the corresponding t's and m's) on the contracted indices 
that are compatible with the given j's on the open indices. 



where | jAtj^ ; J's^jb ) = IjAij^) ® bs^jB)- Here coefficients 
^iTt- i„t- -»i ADt can all be chosen to be either zero or 

JA JA'JB JAB Jj\B 

one corresponding to the choice of a change of basis that maps 
vectors \jAtjA \ jBtjB) to vectors IjABtj^B) in ^ one-to-one 
way (see Examples B9 and BIO). The product basis can be 
expressed in terms of the coupled basis as 



IjAtjAmjA-jBtjBmjB) 

V V V T=p'" 

Z-^ Z-^ Z-^ JABtjAl 



JAB tjAB "^lAE 



"■3AB ^JA*JA™3^ .JBtjB^lj 
IjABtjAB'mjAB), 



(B60) 



where 



-"A J A JA ■'B 3B JI 



^y^ split 

iABtjAB"^ 
■tr split ^ split 

JABtjAB -*^At,A 'iBtjB JABrrij^^ ^JA^ja •JB^jg ' 



(B61) 



and 



Y ^P^^* = Y ^^^^ (Tif\0^ 

^JABijAB^^AtjA-iB^JB - ^ 3 At j a'^ j B AB^ j ab ' > 

The graphical representation** of the transformations T '""^ 
and X and their decomposition into X and C terms is 
shown in Fig[27i;a)-(b). By construction, T''"^'^ and T=p'" ful- 
fill the equalities that are depicted in Fig[27Kc). 

Example BIO. Consider vector spaces V''^' and V'^^ that 
both correspond to the vector space of Example B4, 

2 2 2 2 

The product space V^"*-^' = V*'*' ® V'-^' decomposes as 
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where 



and 
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(B63) 
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A coupled basis \jABti 



j) can be introduced in 



(B64) 



by performing a change of basis T'""" from the product ba- 
sis for the spaces V^'^' and V'^'. For fixed values of jA,jB 
and Jab the transformation T'"^'' decomposes into 
and (7'"== parts. The C'"^"" part relates the coupled basis 



IjABrrij^^) of 



JAB) 



to the basis \ jA = | 



2 ' "'^A 1 



of (V*!*^ !8> Vi^^), as described in Example B9. Analogously, 

2 2 

the X'""" part relates the coupled basis IjABtjj^^) to the prod- 
uct basis \ jA ~ ^jtjA'jJB ~ f i^is) in the degeneracy spaces 
KT^j^B = 0,1. The coefficients ^/^T,, 



that correspond to the change of basis in iwq 
chosen to be zero except 



(AB) 



can all be 
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Similarly, the non-zero coefficients Xj^^^ 
that correspond to the change of basis in 
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= 1. 



Note that the change of basis in a degeneracy space, as de- 
scribed by is not constrained by symmetry and there- 
fore we can fix the value of coefficients 
to be or 1 in this simple way. I 

Example Bll. Let V''*' and V'^' correspond to the vector 
spaces of Example B3 and Example B5 respectively, that is. 
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Here the non-zero coefficients X/" „ , . ^ , . „ , . that cor- 

'J±s JA±S JAB 

respond to the change from the product basis to the coupled 



basis in the three degeneracy spaces Dq'^^' , Dj'^^^ 



and 



^ll,ll->01 — 

Xfuac -tr fuse -y fuse 

11,01-Hl — All 02^-12 — Aii_ii_j.i3 — 

-^1M1->21 = 1. I 

6. Intertwiners and F-moves 

Now consider the action of SU(2) on a space V that is a 
tensor product of L vector spaces, 



/(O 



(B65) 



where each vector space V''^ ,1 — 1,2, . . . , L, transforms as a fi- 
nite dimensional representation of SU(2) as generated by spin 
operators Ja\a — x,y,z. We consider the action of SU(2) 
on the space V that is generated by the total spin operators, 

(B66) 



Ja — ^ ^ Ja\ — X,y,Z, 



(each term in the sum acts as Ji' ' on site I and the Identity 
on the remaining sites) and which corresponds to the unitary 
transformations 



(0 



(B67) 



In the tensor product of L representations one can consider 
different coupled spin bases corresponding to the existence of 
different ways of decomposing the tensor product space into 
the factor spaces. For example, the tensor product v''*^'^' = 
V'^-'®V'^'®V''^' of L = 3 representations can be decomposed 
as 



jiABC) r^Y(AB) ^y(C)^ 
Y(AB) ^^(A) ^^(B)^ 

j(ABC) ^ v'^' (g) V'^^\ 
y(SC) ^ y(B) ^ v''^'. 



(B68) 



(B69) 



For simplicity, let us consider that V'^', V<-^' and V''^' trans- 
form as irreps Ja, js and jc respectively. The space Vas in 
(|B68I) then generally decomposes as 



j(AB) 



MB) 
JAB ■ 



(B70) 



The space v''*^'^' is also reducible, and may contain several 
copies of an irrep jabc- It decomposes as 



AABC) 



e 



AABC) 
3 ABC ,iAB ' 



(B71) 



where we have used jab to label different copies of irrep Jabc ■ 



Let 



3A3B3C3ABC ' 3 A 3B JC lABC 



denote the change of 
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FIG. 28: The F-move that relates two difTerent ways of fusing 
three spins jA,jB,jc into a total spin Jabc, Ea. (|B75|l . 



basis to the corresponding coupled basis \ jABcmj^g^,jAB)- 
In terms of Clebsch-Gordan coefficients we have 



3AJBJC3ABC ' J A OB OC OABC 



c 



describe the change to the 

coupled basis \jABC'mjJ^gf^,jAB) in V''^^'^'. 

Alternatively, we can consider the decomposition (|B69|) of 
V'^^"^' into factor spaces where 



(BC) 



(BC) 
3BC ' 
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Ja I ^jAJsjc /\ 
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Ja Ja Ja Ja 



3ABmjjiS'^C"^jC^3ABC-n^jABC ' 

"jab 

(B72) 

where the coefficients C'jf^m,^ jem^-g ^j^sm^^^ describe 
the change of basis to the coupled basis \jAB'mjJ^^) 
in the intermediate space v''*^' and the coefficients 



FIG. 29: (a) An F-move that relates two different ways of 
fusing two incoming and two outgoing spins, (b) A special 
instance of (a) corresponding to setting jo = and the only 
compatible value ja — jc and Jh = Ja, Eq. (|B79|) . (c) Depict- 
ing the F-move (6) in terms of a left-directed cup, Ea. (|B79|) . 
to explicitly indicate the upward bending of index {jA,rnjJ^). 

(d) The inverse of (c) i.e. the downward bending of in- 
dex (jA,mjj^), as explicitly depicted by a left-directed cap, 
Eq. (|B80|) . Contrast the bending of indices of the Clebsch- 
Gordan tensors C""™ and C^^'" in (c) - (d) with Fig|20TaV 

(e) Right directed cups and caps are related to their left coun- 
terparts by a factor RJ^^^^q. 



independent definition is given in terms of the 6-j symbols of 
SU(2), 



and use jbc to label another coupled basis \ jABC''nj^^(, , Jbc) 
ofV^-*^^). Denote by (Q7^^ , , )m- ^m- the 

3A3BJC3ABC ' 3 A IB 3C 3 ABC 

corresponding change of basis, 



(Q 



'3BC \ 

3A3B3C3ABC ''^3a "^3B "^3C "^3 ABC 



A » fuse 

C^3BC"^3bC ' 3Amj^,jBC"^3BC^^ABC"^jABC' 



(B74) 

Here Q',if^jc3ABc ^^^d QJZ'b3c3abc '^'^'1^-4 mtertwmers 
or generalized Clebsch-Gordan coefficients of the group SU(2). 

The two coupled bases liAsCTijAsc > Mb) and 
IjABcmj^^^jjBc) are related by an F-move (see Fig |28|l 







'3bC 

3A3B3C3ABC 



Ep3AB3BC O^^^ 
3A3b3C3ABC^3A3b3C3ABC ' 



(B75) 



where -Fff f are the recoupling coefficients of SU(2). 

By using Eqs. (IB72|) and (IB74[I the recoupling coefficients can 
be expressed in terms of Clebsch-Gordan coefficients as 



p3AB3BC 

3AjBjciABC 



E (p3Amj 



{2jABC + iy^: 



C 



A ,3Bmjj^~i]ABmjj^^ ^JAfimj^B .JCmj^^JABCmj^^^ 

fuse f 

'^3Bm.j^ .iC^iC ^JBCmjBc '3BCm.jg^ ^jABC^iABC , 

(B76) 

where the summation is over mj^ , rrij^ , rrij^ , rajj^^ , rrijg^ 
and rrijABc- Since all the m's are summed over, the recou- 
pling coefficients depend only on the j's. A manifestly m 



pJAB3BC _ 1- 
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JA JB JAB 
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where 

K = (-f)(^''^+-''^+^'^+^'-*^c.)^(2j^^ + l)(2jsc + 1). (B78) 

Other F-moves are possible corresponding to a different 
arrangement of arrows, as illustrated in Fig |29r al. Notice 
that the F-move (6) is a special instance of (a) corresponding 
to the choice jo = and only compatible values jc = jc and 
jH ~ jA ■ Also notice that the index {jA , mj^ ) appears as 
outgoing on the split tensor (l.h.s.) and as incoming on the 
fuse tensor (r.h.s.). Thus, this F-move corresponds to bending 
the index {jA,mjA) of the split tensor upward from the left. 
This is depicted more explicitly (c) where we have deleted the 
jo = edge and replaced its parent tensor with a left directed 
"cup". Here we have defined 



3 A' J A 
^''3A3b3C 



A 1/2^ fuse 
3 A ^3A-n^3A-3A "^'j^' 

A^/^ p3A3C 
3 A OiA3Bic^ 
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where Aj^ = 2jA + 1 is the dimension of irrep ja . The F-move 
(d) is the inverse of (c) where 



'ra; , ,m 



3 A ' JA 



(_^\2jA ^l/2^split 

^ ' 3 A 00-»jA'nj_4 .JA "^'ja ' 
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^ ^1 ^3 A ^3C3a03b- 



(B80) 



(Notice the additional factor (— l)^-*-*). That is, the F-move 
(d) describes the downward bending of index (jA,mj^), as 
explicitly depicted by a left directed "cap" . 



More generally, the cup-cap^ transformations and the F- 
moves (c) — (d) play an instrumental role in bending indices 
of an SU(2)-invariant tensor, as described in Sec. IIIII By con- 
struction the cup and cap fulfill 

which ensures that indices are bent in a reversible way. Right 
directed cup and caps may also appear, corresponding to 
bending indices from the right. These are equal to their left 
counterparts times a factor, see Fie: l29f el. 

Finally, we remark that in the tensor product of L > 3 
representations two different coupled bases may be related by 
several F-moves. 



Appendix C: Practical implementation of 
SU(2)-invariant tensors 

In this appendix we describe in detail a possible implemen- 
tation of the set V of primitive tensor network manipulations 
[App. lA 5) for SU(2)-invariant tensor networks. Our imple- 
mentation is based on tree decompositions of SU(2)-invariant 
tensors. A tree decomposition of an SU(2)-invariant tensor 
is a canonical decomposition [Sec. Ill B| where the underlying 
fusion-splitting tree is made of only splitting vertices i.e. a 
splitting tree. The highlight of working with tree decomposi- 
tions is that the reversal, permutation and reshape of indices 
of SU(2)-invariant tensors simply correspond to the multipli- 
cation of an SU(2)-invariant matrix and vector (see App. [CTl 
for other benefits of using tree decompositions). 



1. Tree decompositions of SU(2)-invariant tensors 

A tree decomposition, denoted T>{T), of a rank-4 SU(2)- 
invariant tensor T with indices 11,22,13,44 and directions 
'in', 'out', 'out', and 'in' is shown in Fig |30l It consists of (i) an 
SU(2)-invariant vector v with components {v)i, (ii) three split 
tensors X"^'"', and (iii) two cups [Fig |29f c').("e')]. The cups are 
attached to indices that are incoming in T, that is, ii and 
14; the parity (left or right) of the cups is additionally speci- 
fied. In the figure, T' denotes the SU(2)-invariant tensor with 
only outgoing indices that is obtained by bending the incom- 
ing indices of T (using the cap transformations, Fig |29f d')'). 
Equivalently, tensor T may be recovered by multiplying T' 
and the corresponding cups. 

The tree decomposition 'D{T) is obtained by inserting a 
resolution of Identity T{t) as shown and then multiplying 
together T' and all the fuse tensors in T{t) to obtain the 
vector i}. The resolution of Identity I(t) is given by a tensor 
network made of tensors T'"""" that fuse the indices of T' 
according to the given fusion tree r and the corresponding 
tensors X that invert this fusion. 

More generally, a tree decomposition 'D{T) of a rank-fc 
SU(2)-invariant tensor T with ki„ incoming indices consists of 
an SU(2)-invariant vector v with an index i that is obtained 
by fusing indices i\,i2, ■ ■ ■ ,ik according to a fusion tree r, the 
{k — 1) split tensors that invert this fusion and kin cups. In 
practice, the tree decomposition T>{T) of an SU(2)-invariant 
tensor T can be stored in memory by storing the following 
data: 




FIG. 30: (Color online) A tree decomposition of an SU(2)- 
invariant tensor T with components (T')iii2i3i4 and directions 
{'in', 'out', 'out', 'in'}. It comprises of an SU(2)-invariant 
vector V, three split tensors T"^''' and two cups. Tensor T' 
is obtained by bending the incoming indices (ii and 14) of T. 
The tree decomposition of tensor T is obtained by applying 
a resolution of Identity T{t) on the indices of T' where I(t) 
corresponds to a tensor network made of fuse and split ten- 
sors that are interconnected according to a given fusion tree 

T. 




(a) (b) (c) 

FIG. 31: (Color online) (a) Two different tree decomposi- 
tions of a rank-4 SU(2)-invariant tensor corresponding to the 
choice of two different fusion trees and r^. The two tree 
decompositions are obtained from the tensor by means of the 
resolutions of Identity (b) I{t'^) and (c) X(t^) as illustrated 
in Figl30l 



1. the indices ii = {ji,tj^,mj^), 

2. the parity of the bend B on each index e.g. for 
the tree decomposition of Fig l30l we have B = 
{'left', 'straight', 'straight', 'right'}, 

3. the fusion tree r according to which the indices of the 
tensor are fused into the single index i (equivalently, 
we also say that the tree decomposition is based on an 
underlying splitting tree r), and 

4. the vector v. 
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FIG. 32: (Color online) Mapping between two tree decompo- 
sitions [FigEI] V^if) and (f) of an SU(2)-invariant ten- 
sor T. Tree decomposition (T) is obtained from {T) in 
two steps. First the resolution of Identity I(t^) is applied on 
(T) as shown and a matrix F is obtained by multiplying 
together the split tensors in T)-^ [T) and the fuse tensors in 
T{t^). Then vector G (T) is obtained by multiplying 



F with V, Eq.dCT 



2. Mapping between tree decompositions 





I 




FIG. 33: (Color online) Bending indices of an SU(2)-invariant 
tensor T that is given in the tree decomposition 'D{T) to ob- 
tain another SU(2)-invariant tensor T". The only non-trivial 
cases are bending down a 'left' index from the right (shown 
here) and bending a 'right' index from the left, which results 
in a "loop" as shown. A tree decomposition of the tensor T' is 
obtained by subsuming the loop into T>{T). This is achieved 
by applying the resolution of Identity T{t) as shown, straight- 
ening the loop (inset) then multiplying together the resulting 
swap factors, the split tensors in D(r) and the fuse tensors in 
X{t) to obtain a matrix p'^"'"'. The vector v' that comprises 
the tree decomposition of T' is obtained by multiplying r'"="'^ 
with V, Ea. (IC2)l . 



The same tensor T may be expressed in different tree de- 
compositions corresponding to different choices of the fusion 
tree. A different choice of left and right directed cups also 
generally corresponds to a different tree decomposition of the 
tensor (see Sec. lC 3[) . However, here we will only consider how 
tree decompositions with different fusion trees are related. 

Two different fusion trees and lead to two different 
tree decompositions ©^(T) and (T) of the same tensor 
T, as illustrated in Fig lSlf aV The two decompositions are 
obtained from the tensor T by means of the resolutions of 
Identity I(t'^) and X(t^) [Fig |31f b')-(c')] as explained pre- 
viously. Suppose now that we have a tensor T in a tree de- 
composition O'^ (T) and we wish to transform it into another 
tree decomposition (T). This can be achieved by applying 
the resolution of Identity I(t^) on the tree decomposition 
V^{f) as shown in FigEl The new vector ij^ is obtained 
from 1)'^ as 

v^ = rv^, (CI) 

where F is a matrix that is obtained by multiplying together 
the split tensors T '^^'^ in O'^ (T) and the fuse tensors T in 
(T). By construction, the matrix F is SU(2)-invariant and 
has a block-diagonal form. Notice that only the block with 
ji = is relevant in Ea. (|Cl|) . since F is multiplied with an 
SU(2)-invariant vector ii. (App. IC 71 describes how to obtain 
the matrix F in the block diagonal form in practice.) 

Next we describe how the set V of primitive tensor network 
manipulations, namely, the reversal, permutation and reshape 
of indices, and matrix multiplication and matrix factorization, 
are adapted to tree decompositions of SU(2)-invariant tensors. 



3. Reversal of indices 

Consider an SU(2)-invariant tensor T that is given in a tree 
decomposition ©(T) = {{ii, 12, ■ ■ ■ , ik}, B, r, v) and let T' de- 
note the SU(2)-invariant tensor obtained from T by bending 
some of its indices. When bending a 'straight' index either 
leftward or rightward, a tree decomposition T>{T') of tensor 
T' is obtained by simply attaching the left or right directed 
cup to the index in the tree decomposition T>(f) respectively. 
In practice, this corresponds to only updating the parity of 
the index in B to 'left' or 'right'. In particular, the decompo- 
sitions TJ(T) and T>{T') comprise of the same vector v. 

Next, when bending (downward) a 'left' index from the left 
or a 'right' index from the right, a tree decomposition of T' 
is obtained from T>{T) by simply detaching the original bend 
(cup) from the index. Once again, in practice, this corre- 
sponds to simply updating the parity of the index in _B, to 
'straight' in this case. 

However, bending a 'left' index from the right or a 'right' 
index from the left results in a "loop", as shown in Fig |33l 
A tree decomposition of tensor T' is obtained by subsuming 
the loop into T>{T). This is achieved by first applying the 
resolution of Identity T{t) as illustrated in the figure. The 
vector v' that comprises the tree decomposition of T' is then 
obtained as 

V = f """fi, (C2) 

where F'"'"'' is the SU(2)-invariant matrix obtained by 
"straightening" (see inset of Fig |33|) the loop(s) and multi- 
plying together the resulting swap factors, the split tensors 
Y=piit -jj 2,(f ) and the fuse tensors T'"™ in X{t). 
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FIG. 34: (Color online) Permuting (or intercrossing) indices 
of an SU(2)-invariant tensor T that is given in a tree decom- 
position T>(T) to obtain another SU(2)-invariant tensor T'. 
A tree decomposition of the tensor T' is obtained by sub- 
suming the intercrossings into the decomposition T){T). This 
is achieved by applying a resolution of Identity I(t') (for a 
specified fusion tree r') as shown and then multiplying to- 
gether the split tensors in T){T) and the fuse tensors in I(t') 
to obtain a matrix f^"'". The vector v' that comprises the 
tree decomposition of T' is obtained by multiplying Y^""^ and 
the vector w, Ea. (fC3)) . 

4. Permutation of indices 

As described in App. lA 21 an arbitrary permutation of 
indices of a tensor can be decomposed into a sequence of re- 
versals and pairwise swaps. For a tree decomposition this 
corresponds to first detaching all the cups, then intercrossing 
the indices and finally reattaching the cups. This is equivalent 
to applying the permutation of indices before the cups (i.e. in 
the corresponding graphical representation the intercrossing 
of lines appears above the cups). Thus, cups are irrelevant 
when subsuming the intercrossings (permutation of indices) 
into the tree decomposition. 

Consider an SU(2)-invariant tensor T' that is obtained by 
permuting, in an arbitrary way, the indices of an SU(2)- 
invariant tensor T given in the tree decomposition T>{T). A 
tree decomposition T>{T') of the tensor T' is obtained by sub- 
suming the intercrossings into the decomposition ©(T). This 
is achieved by first applying the resolution of Identity I{t'), 
as illustrated in Fig l34l where r' is the fusion tree specified 
for the decomposition T>{T'). Vector v' that comprises the 
decomposition T){T') is then obtained as 

V = f (C3) 

where pp'™ ig the SU(2)-invariant matrix obtained by multi- 
plying together the split tensors in T>{T) and the fuse tensors 
in X{t'). 

5. Reshape of indices 

Two 'straight' indices of an SU(2)-invariant tensor given 
in a tree decomposition are fused by using the transforma- 
tion T A 'straight' index is split into two indices by using 




FIG. 35: (Color online) Reshaping indices of an SU(2)- 
invariant tensor T that is given in a tree decomposition T){T) 
to obtain another SU(2)-invariant tensor T' . Fusion and split- 
ting of 'straight' indices is by using transformations T'"''° and 
T ''''''' respectively, (a) Fusion of two 'straight' indices of T 
that belong to the same split tensor in the tree decomposition 
T){T). A tree decomposition of T' is obtained by simply delet- 
ing the split tensor, Ea.H27[). (b) Tensor T is recovered from 
T' by splitting back the fused index. That is, the tree decom- 
position T>{T) is recovered by reattaching the split tensor to 
the tree decomposition of T' . 

the transformation X'''''''. Consider an SU(2)-invariant tensor 
T' obtained by fusing two 'straight' indices ii and of an 
SU(2)-invariant tensor T. Let us work in a tree decomposition 
D(r) of the tensor T in which ii and belong to the same 
split tensor. Then a tree decomposition T>{T') of the tensor 
T' is obtained by simply deleting that split tensor from ©(T), 
as illustrated in Fig lSSf a). (Since the split tensor cancels out 
with the applied fuse tensor, Fig[27jc)). Tensor T may be 
recovered from T' by splitting the fused index back into in- 
dices ii and ij+i. That is, the tree decomposition ©(T) is 
recovered by reattaching the split tensor T to the decom- 
position T){T'), as illustrated in Fig |35f bV Note that the tree 
decompositions T>{T') and T>{T) comprise the same vector. 

Finally, consider reshaping an SU(2)-invariant tensor by 
fusing a 'left'/'right' index with a 'straight' index. Once again, 
consider that the two indices belong to the same split node 
in the tree decomposition. In this case the reshape proceeds 
by first detaching the left/right cup and then fusing the two 
indices as described above. The original tensor, and its tree 
decomposition, may be recovered by simply reattaching the 
removed T^'"'"' and the removed cup. 



6. Matrix multiplication and factorizations 

Two SU(2)-invariant matrices, each given as a tree decom- 
position, may be multiplied together by first obtaining the 
matrices in a block-diagonal form (that is, the (P, Q) form 
described in Sec. IIIBf) from the respective tree decomposi- 
tions, performing block-wise multiplication (see Sec. IIIIE[) 
and recasting the resulting block-diagonal matrix into a tree 
decomposition. An SU(2)-invariant matrix may be factorized 
e.g. singular value decomposed in a similar way. That is, by 
first obtaining the matrix in a block-diagonal form, then per- 
forming block- wise factorization (see Sec. IIII F|l . and finally 
recasting each of the factor block-diagonal matrices into a 
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(a) 




FIG. 36: (Color online) (a) Obtaining the block diagonal form 
(i.e. the (P, Q) form) of an SU(2)-invariant matrix from its 
tree decomposition (left) by performing two multiplications 
(highlighted by shading). First, the vector i) is multiplied with 
the split tensor to obtain an intermediate SU(2)-invariant ten- 
sor T' . Then T' is multiplied with the cup to obtain the 
block diagonal matrix T. (b) The two multiplications of (a) 
as performed in the canonical form at each step. The "mul- 
tiplication" with the cup simply corresponds to applying the 
F-move of Figgltb). 



only O's and I's in a ver y sp ecific way. We refer the reader 
to the appendix of Ref. [73 where one method for the fast 
multiplication of the X tensors was outlined^. 

In this appendix we have described how by working in tree 
decompositions the reversal, permutation and reshaping of in- 
dices of SU(2)-invariant tensors corresponds to multiplying a 
matrix with an SU(2)-invariant vector [Eqs. (|C1|) - (|C3|) ]. Note 
that these matrices are purely structural and do not depend 
on the components of tensors that are e.g. reshaped or per- 
muted. In the specific context of algorithms where the same 
tensor manipulations are iterated many times the same struc- 
tural matrices are computed in every iteration. In such a sce- 
nario it is possible to significantly decrease the running cost 
by precomputing all such matrices once and reusing them in 
subsequent iterations thus reducing computational times at 
the expense of incurring an additional memory cost. In our 
implementation the use of precomputation led to a significant 
speedup of simulations, Fig llSI We also remark that by im- 
plementing tensor network algorithms in terms of only matrix 
operations the implementation code is readily set up for fur- 
ther optimization by using vectorization and parallelization 
techniques. 



tree decomposition. 

The tree decomposition of an SU(2)-invariant matrix T 
consists of a vector v, a split tensor X^'"'"' and a cup. The 
block diagonal form of T can be obtained from its tree de- 
composition as shown in Fig |36l Analogously, the tree de- 
composition of an SU(2)-invariant matrix T can be obtained 
from its block-diagonal form by reversing the depicted proce- 
dure. 



7. Precomputation scheme for iterative tensor 
network algorithms 

We conclude this appendix by describing how the SU(2)- 
invariant matrix F of Eq. (|Cl|l . and also the closely related 
SU(2)-invariant matrix f of Eq.JCH) and f p"" of Ea. ((C3|) . 
is obtained in the block-diagonal form. 

The SU(2)-invariant matrix F of Fig |32l is separately shown 
in Fig |37l It is obtained by contracting a tensor network M 
made of fuse tensors T'"°° and split tensors "f and de- 
composes as 

f = 0(I),®/,). (C4) 

Here we are interested only in the j = block since F is mul- 
tiplied with the SU(2)-invariant vector i). The (degeneracy) 
matrix -Dj=o is obtained as explained by Fig |37l Note that 
the contraction of the X tensors can be performed in a fast 
way by exploiting the fact that they are sparse and made of 




FIG. 37: The matrix f of Ea. (|Cl|l is obtained by contracting 
a tensor network M made of fuse and split tensors. Only the 
j = block {bj^o in Eq. (|C4|) ') of f is relevant. For fixed 
values of j's on all the contracted indices, compatible with 
j = Q on the two open indices, each tensor T'"^'' and X^^'"' 
decomposes into X and C parts. Subsequently, the tensor 
network M factorizes into two terms tensors. The first one is 
a tensor network is made of X tensors that can be contracted 
to obtain a matrix made of O's and I's. The second term 
is a spin network which, here, can be contracted to obtain 
a number (the "value" of the spin network) since the open 
indices take only one value: j = Q,m = Q, i.e. have size one. 
This "evaluation" can be achieved by applying a sequence of 
F-moves (instead of actually multiplying the Clebsch-Gordan 
tensors). Therefore, the value of the spin network is given in 
terms of F coefficients (and possibly also the /J """p coefficients 
when considering the contractions for obtaining the matrices 
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